Comprehensive utilities library for JAX testing, debugging, and instrumentation
73
{
"context": "This evaluation assesses how effectively the engineer uses chex's Dimensions class to implement the shape template manager functionality. The focus is on leveraging chex's built-in dimension management capabilities rather than reimplementing them from scratch.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses Dimensions class",
"description": "Implementation uses chex.Dimensions as the core mechanism for managing dimensions, rather than implementing dimension management from scratch with dictionaries or other data structures.",
"max_score": 40
},
{
"name": "String-based retrieval",
"description": "Leverages Dimensions class's built-in string key indexing (e.g., dims['BTN']) to retrieve dimension tuples, demonstrating understanding of the string-based dimension lookup feature.",
"max_score": 20
},
{
"name": "Flattening syntax",
"description": "Correctly uses parentheses notation for axis flattening (e.g., dims['(BT)D']) to multiply dimensions together, utilizing Dimensions class's built-in flattening capability.",
"max_score": 20
},
{
"name": "Wildcard support",
"description": "Utilizes the Dimensions class's native wildcard handling (e.g., dims['B*T']) where '*' represents None, rather than custom wildcard implementation.",
"max_score": 20
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-chexevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10