or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/chex@0.1.x
tile.json

tessl/pypi-chex

tessl install tessl/pypi-chex@0.1.0

Comprehensive utilities library for JAX testing, debugging, and instrumentation

Agent Success

Agent success rate when using this tile

73%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.92x

Baseline

Agent success rate without this tile

38%

rubric.jsonevals/scenario-1/

{
  "context": "This criteria evaluates how well the engineer uses the chex library's tree comparison utilities, specifically focusing on the assert_trees_all_close_ulp function for ULP-based floating-point comparisons and related tree structure validation functions.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses assert_trees_all_close_ulp",
      "description": "Implementation uses chex.assert_trees_all_close_ulp() function to perform the core comparison between expected and actual outputs with ULP-based tolerance",
      "max_score": 40
    },
    {
      "name": "Passes max_ulp parameter",
      "description": "The max_ulp parameter from validate_outputs() is correctly passed to chex.assert_trees_all_close_ulp() as the maximal_ulp argument",
      "max_score": 15
    },
    {
      "name": "Handles tree structures",
      "description": "Implementation correctly handles nested data structures (PyTrees) including dictionaries, lists, and arrays as required by the test cases",
      "max_score": 20
    },
    {
      "name": "Error handling",
      "description": "Implementation catches exceptions from chex assertions and re-raises or wraps them as ValueError with informative error messages as specified in the API",
      "max_score": 15
    },
    {
      "name": "Minimal implementation",
      "description": "Implementation leverages chex library capabilities directly without reimplementing floating-point comparison logic or tree traversal",
      "max_score": 10
    }
  ]
}