Comprehensive utilities library for JAX testing, debugging, and instrumentation
73
{
"context": "This evaluation assesses how effectively the engineer uses the chex library to validate array sharding in JAX computations. The focus is on proper usage of chex.assert_tree_is_sharded and understanding of sharding validation concepts.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses assert_tree_is_sharded",
"description": "The implementation uses chex.assert_tree_is_sharded() as the primary mechanism for validating array sharding",
"max_score": 40
},
{
"name": "Handles single arrays",
"description": "Correctly validates sharding of single JAX arrays by passing them to assert_tree_is_sharded",
"max_score": 15
},
{
"name": "Handles nested structures",
"description": "Correctly validates sharding of nested data structures (PyTrees) by leveraging assert_tree_is_sharded's PyTree support",
"max_score": 20
},
{
"name": "Handles empty structures",
"description": "Correctly handles empty structures without errors when passed to assert_tree_is_sharded",
"max_score": 10
},
{
"name": "Exception propagation",
"description": "Allows AssertionError from assert_tree_is_sharded to propagate when validation fails, without catching or suppressing the error",
"max_score": 15
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-chexevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10