or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/chex@0.1.x
tile.json

tessl/pypi-chex

tessl install tessl/pypi-chex@0.1.0

Comprehensive utilities library for JAX testing, debugging, and instrumentation

Agent Success

Agent success rate when using this tile

73%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.92x

Baseline

Agent success rate without this tile

38%

rubric.jsonevals/scenario-6/

{
  "context": "This evaluation assesses how effectively the engineer uses chex's Dimensions class to implement the shape template manager functionality. The focus is on leveraging chex's built-in dimension management capabilities rather than reimplementing them from scratch.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses Dimensions class",
      "description": "Implementation uses chex.Dimensions as the core mechanism for managing dimensions, rather than implementing dimension management from scratch with dictionaries or other data structures.",
      "max_score": 40
    },
    {
      "name": "String-based retrieval",
      "description": "Leverages Dimensions class's built-in string key indexing (e.g., dims['BTN']) to retrieve dimension tuples, demonstrating understanding of the string-based dimension lookup feature.",
      "max_score": 20
    },
    {
      "name": "Flattening syntax",
      "description": "Correctly uses parentheses notation for axis flattening (e.g., dims['(BT)D']) to multiply dimensions together, utilizing Dimensions class's built-in flattening capability.",
      "max_score": 20
    },
    {
      "name": "Wildcard support",
      "description": "Utilizes the Dimensions class's native wildcard handling (e.g., dims['B*T']) where '*' represents None, rather than custom wildcard implementation.",
      "max_score": 20
    }
  ]
}