CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-chex

Comprehensive utilities library for JAX testing, debugging, and instrumentation

73

1.92x
Overview
Eval results
Files

rubric.jsonevals/scenario-9/

{
  "context": "This evaluation assesses how effectively the engineer uses the chex library to validate array sharding in JAX computations. The focus is on proper usage of chex.assert_tree_is_sharded and understanding of sharding validation concepts.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses assert_tree_is_sharded",
      "description": "The implementation uses chex.assert_tree_is_sharded() as the primary mechanism for validating array sharding",
      "max_score": 40
    },
    {
      "name": "Handles single arrays",
      "description": "Correctly validates sharding of single JAX arrays by passing them to assert_tree_is_sharded",
      "max_score": 15
    },
    {
      "name": "Handles nested structures",
      "description": "Correctly validates sharding of nested data structures (PyTrees) by leveraging assert_tree_is_sharded's PyTree support",
      "max_score": 20
    },
    {
      "name": "Handles empty structures",
      "description": "Correctly handles empty structures without errors when passed to assert_tree_is_sharded",
      "max_score": 10
    },
    {
      "name": "Exception propagation",
      "description": "Allows AssertionError from assert_tree_is_sharded to propagate when validation fails, without catching or suppressing the error",
      "max_score": 15
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-chex

tile.json