Dark magics about variable names in python
90
Pending
Does it follow best practices?
Impact
90%
1.40xAverage score across 10 eval scenarios
Pending
The risk profile of this skill
{
"context": "This criteria evaluates how effectively an engineer uses the varname package to implement automatic variable name capture for simple assignments. The focus is on proper usage of varname's core functions to handle basic assignment scenarios including simple assignment, attribute assignment, and subscript assignment.",
"type": "weighted_checklist",
"checklist": [
{
"name": "varname() function usage",
"description": "Uses the varname() function from the varname package to retrieve the assignment variable name in the __init__ method",
"max_score": 35
},
{
"name": "Simple assignment handling",
"description": "Correctly captures variable names for simple assignments (e.g., config = NamedObject()) without requiring additional configuration",
"max_score": 20
},
{
"name": "Attribute assignment support",
"description": "Correctly captures the attribute name when assigned to object attributes (e.g., obj.setting = NamedObject()) by properly handling the assignment context",
"max_score": 20
},
{
"name": "Subscript assignment support",
"description": "Correctly captures the key name when assigned to dictionary subscripts (e.g., registry['handler'] = NamedObject()) by properly handling the subscript assignment context",
"max_score": 20
},
{
"name": "Name storage",
"description": "Stores the captured variable name in a manner that allows it to be accessed via the name property as specified in the API",
"max_score": 5
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10