Comprehensive utilities library for JAX testing, debugging, and instrumentation
73
{
"context": "This criteria evaluates how well the engineer uses the chex library's tree comparison utilities, specifically focusing on the assert_trees_all_close_ulp function for ULP-based floating-point comparisons and related tree structure validation functions.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses assert_trees_all_close_ulp",
"description": "Implementation uses chex.assert_trees_all_close_ulp() function to perform the core comparison between expected and actual outputs with ULP-based tolerance",
"max_score": 40
},
{
"name": "Passes max_ulp parameter",
"description": "The max_ulp parameter from validate_outputs() is correctly passed to chex.assert_trees_all_close_ulp() as the maximal_ulp argument",
"max_score": 15
},
{
"name": "Handles tree structures",
"description": "Implementation correctly handles nested data structures (PyTrees) including dictionaries, lists, and arrays as required by the test cases",
"max_score": 20
},
{
"name": "Error handling",
"description": "Implementation catches exceptions from chex assertions and re-raises or wraps them as ValueError with informative error messages as specified in the API",
"max_score": 15
},
{
"name": "Minimal implementation",
"description": "Implementation leverages chex library capabilities directly without reimplementing floating-point comparison logic or tree traversal",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-chexevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10