Data validation using Python type hints
90
Pending
Does it follow best practices?
Impact
90%
1.30xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This criteria evaluates how well the engineer uses Pydantic's path validation types (FilePath and DirectoryPath) to validate file system paths. The focus is on proper usage of these specialized types for enforcing path existence constraints.",
"type": "weighted_checklist",
"checklist": [
{
"name": "FilePath usage",
"description": "Uses Pydantic's FilePath type for the config_file field to validate that the path points to an existing file",
"max_score": 35
},
{
"name": "DirectoryPath usage",
"description": "Uses Pydantic's DirectoryPath type for the data_directory field to validate that the path points to an existing directory",
"max_score": 35
},
{
"name": "Optional path handling",
"description": "Uses Optional type annotation (e.g., Optional[str] or str | None) for the log_file field to make it optional without path existence validation",
"max_score": 20
},
{
"name": "Model definition",
"description": "Correctly defines a BaseModel subclass with proper field type annotations that enable automatic validation",
"max_score": 10
}
]
}docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10