Comprehensive utilities library for JAX testing, debugging, and instrumentation
73
{
"context": "This criteria evaluates how well the engineer uses chex's multi-device testing capabilities to simulate and test parallel JAX computations in a local environment. The focus is on proper use of chex.set_n_cpu_devices() for device simulation and integration with JAX's parallel execution model.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Device Setup Usage",
"description": "Uses chex.set_n_cpu_devices() in setup_multi_device_test() to configure the number of simulated CPU devices for testing parallel code",
"max_score": 30
},
{
"name": "Device Count Query",
"description": "Uses jax.device_count() or jax.devices() appropriately in get_device_count() to query the number of available devices in the JAX environment",
"max_score": 15
},
{
"name": "Parallel Mapping",
"description": "Uses jax.pmap() in test_parallel_sum() to distribute computation across the simulated devices for parallel execution",
"max_score": 30
},
{
"name": "Device Cleanup",
"description": "Properly resets the device configuration in teardown_multi_device_test() using chex.set_n_cpu_devices() to restore original state or uses appropriate cleanup mechanism",
"max_score": 15
},
{
"name": "Test Integration",
"description": "Correctly implements test cases that verify device count after setup, parallel computation results, and state restoration after teardown",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-chexevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10