or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/cupy-cuda101@9.6.x
tile.json

tessl/pypi-cupy-cuda101

tessl install tessl/pypi-cupy-cuda101@9.6.0

CuPy: NumPy & SciPy for GPU (CUDA 10.1 version)

Agent Success

Agent success rate when using this tile

87%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.19x

Baseline

Agent success rate without this tile

73%

rubric.jsonevals/scenario-4/

{
  "context": "This evaluation assesses how well the engineer uses CuPy's CUDA graph capabilities to optimize a repeated matrix computation pipeline. The focus is on proper use of graph capture and replay APIs to reduce kernel launch overhead.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Stream Creation",
      "description": "Creates a CUDA stream using cupy.cuda.Stream() to enable graph capture functionality",
      "max_score": 10
    },
    {
      "name": "Graph Capture",
      "description": "Uses stream.begin_capture() to start capturing operations into a CUDA graph",
      "max_score": 20
    },
    {
      "name": "Operation Recording",
      "description": "Records the complete sequence of operations (matrix multiply, addition, squaring) within the capture context to build the graph",
      "max_score": 15
    },
    {
      "name": "Graph Finalization",
      "description": "Calls stream.end_capture() to finalize the CUDA graph and obtain a graph object",
      "max_score": 20
    },
    {
      "name": "Graph Replay",
      "description": "Uses graph.launch() inside a loop to replay the captured graph for multiple iterations instead of re-executing operations",
      "max_score": 25
    },
    {
      "name": "Computation Correctness",
      "description": "Implements the correct sequence of operations (a @ b, + c, ** 2, update a) that produces mathematically correct results",
      "max_score": 10
    }
  ]
}