Comprehensive utilities library for JAX testing, debugging, and instrumentation
73
{
"context": "This criteria evaluates how effectively an engineer uses Chex's JAX-friendly dataclass decorators (@dataclass and @mappable_dataclass) to create configuration objects that integrate seamlessly with JAX tree utilities. The focus is on proper use of Chex-specific dataclass features for JAX compatibility.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses @dataclass decorator",
"description": "NetworkConfig is decorated with chex.dataclass (or @chex.dataclass), enabling automatic JAX PyTree registration",
"max_score": 25
},
{
"name": "Uses @mappable_dataclass decorator",
"description": "MappableNetworkConfig is decorated with chex.mappable_dataclass (or @chex.mappable_dataclass), enabling both JAX compatibility and dictionary-style access",
"max_score": 25
},
{
"name": "Utilizes from_tuple method",
"description": "Code correctly uses the from_tuple() method (provided automatically by chex decorators) to construct dataclass instances from tuples",
"max_score": 20
},
{
"name": "JAX tree integration",
"description": "Implementation leverages the automatic JAX PyTree registration that chex decorators provide, allowing the dataclasses to work seamlessly with jax.tree_map, jax.tree_util.tree_flatten, and jax.tree_util.tree_unflatten without manual registration",
"max_score": 20
},
{
"name": "Dictionary-style access",
"description": "Implementation correctly leverages mappable_dataclass's automatic Mapping interface implementation, enabling dictionary-style access (e.g., config['key']) and iteration methods (.keys(), .values(), .items()) without manual implementation",
"max_score": 10
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-chexevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10