tessl install tessl/pypi-varname@0.15.0Dark magics about variable names in python
Agent Success
Agent success rate when using this tile
90%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.41x
Baseline
Agent success rate without this tile
64%
{
"context": "This criteria evaluates how well the engineer uses the varname package to implement an async task result manager that automatically captures and stores variable names from async operations. The focus is on correct usage of varname's variable name retrieval functionality in async contexts.",
"type": "weighted_checklist",
"checklist": [
{
"name": "varname() import",
"description": "Imports the varname() function from the varname package",
"max_score": 10
},
{
"name": "varname() in __init__",
"description": "Uses varname() function inside TaskResult.__init__() to capture the variable name when the object is instantiated",
"max_score": 25
},
{
"name": "Async function implementation",
"description": "Implements create_task_result() as a proper async function that returns a TaskResult instance with the captured variable name",
"max_score": 20
},
{
"name": "Variable name storage",
"description": "Correctly stores the captured variable name as the identifier attribute in TaskResult, accessible via the identifier property",
"max_score": 15
},
{
"name": "Registry integration",
"description": "Implements TaskRegistry.register() to store TaskResult instances using their captured identifiers as keys",
"max_score": 15
},
{
"name": "Identifier-based retrieval",
"description": "Implements TaskRegistry.get() to retrieve values using the captured variable names as identifiers",
"max_score": 10
},
{
"name": "List all results",
"description": "Implements TaskRegistry.list_all() to return a dictionary mapping all captured identifiers to their stored values",
"max_score": 5
}
]
}