tessl install tessl/pypi-fastcore@1.8.0Python supercharged for fastai development
Agent Success
Agent success rate when using this tile
56%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.37x
Baseline
Agent success rate without this tile
41%
{
"context": "This evaluation assesses how effectively the engineer uses fastcore's testing utilities to build a comprehensive test suite for a data validator. The focus is exclusively on the correct usage of fastcore testing functions like test_eq(), test_close(), test_fail(), and ExceptionExpected to verify behavior, handle exceptions, and validate numerical precision.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Import testing utilities",
"description": "Imports relevant testing functions from fastcore.test such as test_eq, test_ne, test_close, test_fail, or ExceptionExpected",
"max_score": 5
},
{
"name": "Use test_eq correctly",
"description": "Uses test_eq() to verify equality for boolean results (e.g., validate_positive returns True/False, validate_in_range returns True/False, validate_email_format returns True/False)",
"max_score": 20
},
{
"name": "Use test_close for floats",
"description": "Uses test_close() with appropriate epsilon tolerance to verify floating-point results from calculate_average() instead of exact equality",
"max_score": 15
},
{
"name": "Test exceptions with test_fail",
"description": "Uses test_fail() to verify that validate_email_format raises ValueError for non-string inputs and/or process_data raises TypeError for non-string inputs, with correct exception type specified",
"max_score": 20
},
{
"name": "Verify exception messages",
"description": "Uses test_fail() with the 'contains' parameter or ExceptionExpected with regex to verify that exception messages contain expected text (e.g., 'must be a string')",
"max_score": 15
},
{
"name": "Test edge cases",
"description": "Uses fastcore testing functions to test edge cases like empty lists for calculate_average(), negative numbers for validate_positive(), or boundary values for validate_in_range()",
"max_score": 15
},
{
"name": "Create validator instance",
"description": "Creates an instance of DataValidator class and calls its methods in tests (demonstrates understanding of testing instance methods)",
"max_score": 10
}
]
}