tessl install tessl/pypi-chex@0.1.0Comprehensive utilities library for JAX testing, debugging, and instrumentation
Agent Success
Agent success rate when using this tile
73%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.92x
Baseline
Agent success rate without this tile
38%
{
"context": "This criteria evaluates how well the engineer uses chex's multi-device testing capabilities to simulate and test parallel JAX computations in a local environment. The focus is on proper use of chex.set_n_cpu_devices() for device simulation and integration with JAX's parallel execution model.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Device Setup Usage",
"description": "Uses chex.set_n_cpu_devices() in setup_multi_device_test() to configure the number of simulated CPU devices for testing parallel code",
"max_score": 30
},
{
"name": "Device Count Query",
"description": "Uses jax.device_count() or jax.devices() appropriately in get_device_count() to query the number of available devices in the JAX environment",
"max_score": 15
},
{
"name": "Parallel Mapping",
"description": "Uses jax.pmap() in test_parallel_sum() to distribute computation across the simulated devices for parallel execution",
"max_score": 30
},
{
"name": "Device Cleanup",
"description": "Properly resets the device configuration in teardown_multi_device_test() using chex.set_n_cpu_devices() to restore original state or uses appropriate cleanup mechanism",
"max_score": 15
},
{
"name": "Test Integration",
"description": "Correctly implements test cases that verify device count after setup, parallel computation results, and state restoration after teardown",
"max_score": 10
}
]
}