or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/chex@0.1.x
tile.json

tessl/pypi-chex

tessl install tessl/pypi-chex@0.1.0

Comprehensive utilities library for JAX testing, debugging, and instrumentation

Agent Success

Agent success rate when using this tile

73%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.92x

Baseline

Agent success rate without this tile

38%

rubric.jsonevals/scenario-5/

{
  "context": "This criteria evaluates how effectively the engineer uses chex's tree validation utilities to implement parameter validation functionality. The focus is on proper usage of assert_tree_all_finite for validating numerical values and assert_trees_all_equal for comparing PyTree structures.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "assert_tree_all_finite usage",
      "description": "The validate_parameters_finite function uses chex.assert_tree_all_finite() to check that all values in the parameter tree are finite (not NaN or infinity)",
      "max_score": 40
    },
    {
      "name": "assert_trees_all_equal usage",
      "description": "The compare_parameter_trees function uses chex.assert_trees_all_equal() to compare two PyTrees for exact equality in both structure and values",
      "max_score": 40
    },
    {
      "name": "Proper exception handling",
      "description": "The functions allow chex assertion errors to propagate naturally without unnecessary wrapping or suppression, maintaining clear error messages",
      "max_score": 10
    },
    {
      "name": "Correct function signatures",
      "description": "Both functions accept the parameters as specified in the API (validate_parameters_finite accepts a single params argument, compare_parameter_trees accepts params1 and params2)",
      "max_score": 10
    }
  ]
}