CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-pydantic

Data validation using Python type hints

90

1.30x
Overview
Eval results
Files

rubric.jsonevals/scenario-7/

{
  "context": "This criteria evaluates how well the engineer uses Pydantic's path validation types (FilePath and DirectoryPath) to validate file system paths. The focus is on proper usage of these specialized types for enforcing path existence constraints.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "FilePath usage",
      "description": "Uses Pydantic's FilePath type for the config_file field to validate that the path points to an existing file",
      "max_score": 35
    },
    {
      "name": "DirectoryPath usage",
      "description": "Uses Pydantic's DirectoryPath type for the data_directory field to validate that the path points to an existing directory",
      "max_score": 35
    },
    {
      "name": "Optional path handling",
      "description": "Uses Optional type annotation (e.g., Optional[str] or str | None) for the log_file field to make it optional without path existence validation",
      "max_score": 20
    },
    {
      "name": "Model definition",
      "description": "Correctly defines a BaseModel subclass with proper field type annotations that enable automatic validation",
      "max_score": 10
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-pydantic

tile.json