or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/fastcore@1.8.x
tile.json

tessl/pypi-fastcore

tessl install tessl/pypi-fastcore@1.8.0

Python supercharged for fastai development

Agent Success

Agent success rate when using this tile

56%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.37x

Baseline

Agent success rate without this tile

41%

rubric.jsonevals/scenario-8/

{
  "context": "This evaluation assesses how effectively the engineer uses fastcore's testing utilities to build a comprehensive test suite for a data validator. The focus is exclusively on the correct usage of fastcore testing functions like test_eq(), test_close(), test_fail(), and ExceptionExpected to verify behavior, handle exceptions, and validate numerical precision.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Import testing utilities",
      "description": "Imports relevant testing functions from fastcore.test such as test_eq, test_ne, test_close, test_fail, or ExceptionExpected",
      "max_score": 5
    },
    {
      "name": "Use test_eq correctly",
      "description": "Uses test_eq() to verify equality for boolean results (e.g., validate_positive returns True/False, validate_in_range returns True/False, validate_email_format returns True/False)",
      "max_score": 20
    },
    {
      "name": "Use test_close for floats",
      "description": "Uses test_close() with appropriate epsilon tolerance to verify floating-point results from calculate_average() instead of exact equality",
      "max_score": 15
    },
    {
      "name": "Test exceptions with test_fail",
      "description": "Uses test_fail() to verify that validate_email_format raises ValueError for non-string inputs and/or process_data raises TypeError for non-string inputs, with correct exception type specified",
      "max_score": 20
    },
    {
      "name": "Verify exception messages",
      "description": "Uses test_fail() with the 'contains' parameter or ExceptionExpected with regex to verify that exception messages contain expected text (e.g., 'must be a string')",
      "max_score": 15
    },
    {
      "name": "Test edge cases",
      "description": "Uses fastcore testing functions to test edge cases like empty lists for calculate_average(), negative numbers for validate_positive(), or boundary values for validate_in_range()",
      "max_score": 15
    },
    {
      "name": "Create validator instance",
      "description": "Creates an instance of DataValidator class and calls its methods in tests (demonstrates understanding of testing instance methods)",
      "max_score": 10
    }
  ]
}