or run

npx @tessl/cli init
Log in

Version

Files

tile.json

rubric.jsonevals/scenario-2/

{
  "context": "This evaluation assesses how effectively the engineer uses the jsons library's deserialization capabilities to convert JSON strings into typed Python dataclass objects. The focus is on correct usage of jsons.loads() or jsons.load() functions with appropriate type parameters.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses jsons.loads()",
      "description": "The load_config function uses jsons.loads() to deserialize JSON strings into Python objects. This is the primary function for loading from JSON strings.",
      "max_score": 40
    },
    {
      "name": "Passes cls parameter",
      "description": "The cls parameter is correctly passed to jsons.loads() (or jsons.load() if using json.loads first) to specify the target dataclass type for deserialization. This ensures type-safe conversion.",
      "max_score": 30
    },
    {
      "name": "Imports jsons module",
      "description": "The jsons module is properly imported at the top of the file (e.g., 'import jsons').",
      "max_score": 10
    },
    {
      "name": "Handles all config types",
      "description": "The implementation correctly deserializes all three configuration types (DatabaseConfig, APISettings, and FeatureFlags) using the jsons library functions.",
      "max_score": 20
    }
  ]
}