or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/chex@0.1.x
tile.json

tessl/pypi-chex

tessl install tessl/pypi-chex@0.1.0

Comprehensive utilities library for JAX testing, debugging, and instrumentation

Agent Success

Agent success rate when using this tile

73%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.92x

Baseline

Agent success rate without this tile

38%

rubric.jsonevals/scenario-7/

{
  "context": "This criteria evaluates how well the engineer uses chex's multi-device testing capabilities to simulate and test parallel JAX computations in a local environment. The focus is on proper use of chex.set_n_cpu_devices() for device simulation and integration with JAX's parallel execution model.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Device Setup Usage",
      "description": "Uses chex.set_n_cpu_devices() in setup_multi_device_test() to configure the number of simulated CPU devices for testing parallel code",
      "max_score": 30
    },
    {
      "name": "Device Count Query",
      "description": "Uses jax.device_count() or jax.devices() appropriately in get_device_count() to query the number of available devices in the JAX environment",
      "max_score": 15
    },
    {
      "name": "Parallel Mapping",
      "description": "Uses jax.pmap() in test_parallel_sum() to distribute computation across the simulated devices for parallel execution",
      "max_score": 30
    },
    {
      "name": "Device Cleanup",
      "description": "Properly resets the device configuration in teardown_multi_device_test() using chex.set_n_cpu_devices() to restore original state or uses appropriate cleanup mechanism",
      "max_score": 15
    },
    {
      "name": "Test Integration",
      "description": "Correctly implements test cases that verify device count after setup, parallel computation results, and state restoration after teardown",
      "max_score": 10
    }
  ]
}