or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/chex@0.1.x
tile.json

tessl/pypi-chex

tessl install tessl/pypi-chex@0.1.0

Comprehensive utilities library for JAX testing, debugging, and instrumentation

Agent Success

Agent success rate when using this tile

73%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.92x

Baseline

Agent success rate without this tile

38%

rubric.jsonevals/scenario-10/

{
  "context": "This evaluation assesses the engineer's ability to use chex's if_args_not_none decorator for conditional validation of optional parameters. The focus is on correctly applying this utility to handle optional parameters while ensuring required parameters are always validated.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses if_args_not_none",
      "description": "Uses chex.if_args_not_none to conditionally validate optional parameters (bias and/or scale in dense layer, bias in conv layer)",
      "max_score": 40
    },
    {
      "name": "Validates required parameters",
      "description": "Uses chex assertions (assert_shape, assert_rank, or assert_axis_dimension) to validate required parameters: inputs and weights for dense layer, inputs and kernel for conv layer",
      "max_score": 25
    },
    {
      "name": "Correct shape assertions",
      "description": "Uses appropriate chex shape assertion functions (assert_shape with correct expected shapes or assert_rank with correct rank values) for all validated parameters",
      "max_score": 20
    },
    {
      "name": "Validates dimension compatibility",
      "description": "Validates that dimensions match between related parameters (e.g., weights input dimension matches inputs feature dimension, kernel in_channels matches input in_channels, bias/scale length matches output dimension)",
      "max_score": 15
    }
  ]
}