or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/varname@0.15.x
tile.json

tessl/pypi-varname

tessl install tessl/pypi-varname@0.15.0

Dark magics about variable names in python

Agent Success

Agent success rate when using this tile

90%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.41x

Baseline

Agent success rate without this tile

64%

rubric.jsonevals/scenario-7/

{
  "context": "This criteria evaluates how well the engineer uses the varname package to implement an async task result manager that automatically captures and stores variable names from async operations. The focus is on correct usage of varname's variable name retrieval functionality in async contexts.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "varname() import",
      "description": "Imports the varname() function from the varname package",
      "max_score": 10
    },
    {
      "name": "varname() in __init__",
      "description": "Uses varname() function inside TaskResult.__init__() to capture the variable name when the object is instantiated",
      "max_score": 25
    },
    {
      "name": "Async function implementation",
      "description": "Implements create_task_result() as a proper async function that returns a TaskResult instance with the captured variable name",
      "max_score": 20
    },
    {
      "name": "Variable name storage",
      "description": "Correctly stores the captured variable name as the identifier attribute in TaskResult, accessible via the identifier property",
      "max_score": 15
    },
    {
      "name": "Registry integration",
      "description": "Implements TaskRegistry.register() to store TaskResult instances using their captured identifiers as keys",
      "max_score": 15
    },
    {
      "name": "Identifier-based retrieval",
      "description": "Implements TaskRegistry.get() to retrieve values using the captured variable names as identifiers",
      "max_score": 10
    },
    {
      "name": "List all results",
      "description": "Implements TaskRegistry.list_all() to return a dictionary mapping all captured identifiers to their stored values",
      "max_score": 5
    }
  ]
}