or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/chex@0.1.x
tile.json

tessl/pypi-chex

tessl install tessl/pypi-chex@0.1.0

Comprehensive utilities library for JAX testing, debugging, and instrumentation

Agent Success

Agent success rate when using this tile

73%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.92x

Baseline

Agent success rate without this tile

38%

rubric.jsonevals/scenario-3/

{
  "context": "This criteria evaluates how effectively the engineer utilizes the chex library's array shape assertion functions (assert_shape, assert_rank, and assert_equal_shape) to implement the array validation utilities. The focus is on proper usage of chex APIs rather than general coding practices.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses assert_shape",
      "description": "The validate_shape function correctly uses chex.assert_shape() to validate array shapes against expected shapes",
      "max_score": 25
    },
    {
      "name": "Uses assert_rank",
      "description": "The validate_rank function correctly uses chex.assert_rank() to validate the number of dimensions in an array",
      "max_score": 25
    },
    {
      "name": "Uses assert_equal_shape",
      "description": "The validate_equal_shapes function correctly uses chex.assert_equal_shape() to compare shapes across multiple arrays",
      "max_score": 25
    },
    {
      "name": "Wildcard pattern support",
      "description": "The validate_flexible_shape function correctly uses chex.assert_shape() with None wildcards in the expected shape pattern to support flexible matching",
      "max_score": 15
    },
    {
      "name": "Proper error propagation",
      "description": "All validation functions properly allow chex assertion errors to propagate without unnecessary wrapping or modification",
      "max_score": 10
    }
  ]
}