Data validation using Python type hints
90
{
"context": "This criteria evaluates how well the engineer uses Pydantic's path validation types (FilePath and DirectoryPath) to validate file system paths. The focus is on proper usage of these specialized types for enforcing path existence constraints.",
"type": "weighted_checklist",
"checklist": [
{
"name": "FilePath usage",
"description": "Uses Pydantic's FilePath type for the config_file field to validate that the path points to an existing file",
"max_score": 35
},
{
"name": "DirectoryPath usage",
"description": "Uses Pydantic's DirectoryPath type for the data_directory field to validate that the path points to an existing directory",
"max_score": 35
},
{
"name": "Optional path handling",
"description": "Uses Optional type annotation (e.g., Optional[str] or str | None) for the log_file field to make it optional without path existence validation",
"max_score": 20
},
{
"name": "Model definition",
"description": "Correctly defines a BaseModel subclass with proper field type annotations that enable automatic validation",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-pydanticdocs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10