tessl install tessl/pypi-us@3.2.0A package for easily working with US and state metadata
Agent Success
Agent success rate when using this tile
88%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.24x
Baseline
Agent success rate without this tile
71%
{
"context": "This evaluation assesses how well the engineer uses the python-us package to work with state capital timezone information. The focus is on proper usage of State object attributes (capital and capital_tz), state collections (STATES, STATES_AND_TERRITORIES), and state lookup functionality.",
"type": "weighted_checklist",
"checklist": [
{
"name": "State lookup usage",
"description": "Uses us.states module to look up states by abbreviation, either via direct attribute access (us.states.CA) or via us.states.lookup() function",
"max_score": 15
},
{
"name": "capital_tz attribute access",
"description": "Correctly accesses the capital_tz attribute from State objects to retrieve the timezone of state capitals",
"max_score": 20
},
{
"name": "capital attribute access",
"description": "Correctly accesses the capital attribute from State objects to retrieve capital city names",
"max_score": 15
},
{
"name": "State collection iteration",
"description": "Iterates over appropriate state collections (us.STATES, us.STATES_AND_TERRITORIES, or us.states.STATES_AND_TERRITORIES) to process multiple states",
"max_score": 15
},
{
"name": "None handling",
"description": "Properly handles cases where capital or capital_tz may be None, filtering out or returning None appropriately",
"max_score": 15
},
{
"name": "Data structure construction",
"description": "Builds the required dictionary structures correctly: timezone-to-list mappings for grouping and timezone-to-count mappings for counting",
"max_score": 10
},
{
"name": "Function signatures",
"description": "Implements functions with correct signatures matching the API specification: get_capital_timezone(state_abbr), group_capitals_by_timezone(), and count_capitals_per_timezone()",
"max_score": 10
}
]
}