Comprehensive utilities library for JAX testing, debugging, and instrumentation
73
{
"context": "This criteria evaluates how effectively the engineer utilizes the chex library's array shape assertion functions (assert_shape, assert_rank, and assert_equal_shape) to implement the array validation utilities. The focus is on proper usage of chex APIs rather than general coding practices.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses assert_shape",
"description": "The validate_shape function correctly uses chex.assert_shape() to validate array shapes against expected shapes",
"max_score": 25
},
{
"name": "Uses assert_rank",
"description": "The validate_rank function correctly uses chex.assert_rank() to validate the number of dimensions in an array",
"max_score": 25
},
{
"name": "Uses assert_equal_shape",
"description": "The validate_equal_shapes function correctly uses chex.assert_equal_shape() to compare shapes across multiple arrays",
"max_score": 25
},
{
"name": "Wildcard pattern support",
"description": "The validate_flexible_shape function correctly uses chex.assert_shape() with None wildcards in the expected shape pattern to support flexible matching",
"max_score": 15
},
{
"name": "Proper error propagation",
"description": "All validation functions properly allow chex assertion errors to propagate without unnecessary wrapping or modification",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-chexevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10