or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/pydantic@2.11.x
tile.json

tessl/pypi-pydantic

tessl install tessl/pypi-pydantic@2.11.0

Data validation using Python type hints

Agent Success

Agent success rate when using this tile

90%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.3x

Baseline

Agent success rate without this tile

69%

rubric.jsonevals/scenario-7/

{
  "context": "This criteria evaluates how well the engineer uses Pydantic's path validation types (FilePath and DirectoryPath) to validate file system paths. The focus is on proper usage of these specialized types for enforcing path existence constraints.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "FilePath usage",
      "description": "Uses Pydantic's FilePath type for the config_file field to validate that the path points to an existing file",
      "max_score": 35
    },
    {
      "name": "DirectoryPath usage",
      "description": "Uses Pydantic's DirectoryPath type for the data_directory field to validate that the path points to an existing directory",
      "max_score": 35
    },
    {
      "name": "Optional path handling",
      "description": "Uses Optional type annotation (e.g., Optional[str] or str | None) for the log_file field to make it optional without path existence validation",
      "max_score": 20
    },
    {
      "name": "Model definition",
      "description": "Correctly defines a BaseModel subclass with proper field type annotations that enable automatic validation",
      "max_score": 10
    }
  ]
}