tessl install tessl/pypi-us@3.2.0A package for easily working with US and state metadata
Agent Success
Agent success rate when using this tile
88%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.24x
Baseline
Agent success rate without this tile
71%
{
"context": "This evaluation assesses the engineer's ability to use the python-us package's geographic attribute filtering capabilities, specifically the is_contiguous and is_continental attributes. The focus is on correctly leveraging the package's built-in state collections and geographic boolean attributes to filter US states.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses us package",
"description": "Imports and uses the 'us' package (specifically us.states module) to access state data",
"max_score": 10
},
{
"name": "Uses STATES collection",
"description": "Uses the us.states.STATES collection, us.states.STATES_CONTIGUOUS, us.states.STATES_CONTINENTAL, or us.states.STATES_AND_TERRITORIES to access state data",
"max_score": 15
},
{
"name": "Accesses contiguous states",
"description": "Correctly accesses contiguous states either by using the is_contiguous boolean attribute on state objects OR by directly using the us.states.STATES_CONTIGUOUS collection",
"max_score": 30
},
{
"name": "Accesses continental states",
"description": "Correctly accesses continental states either by using the is_continental boolean attribute on state objects OR by directly using the us.states.STATES_CONTINENTAL collection",
"max_score": 30
},
{
"name": "Accesses non-contiguous states",
"description": "Correctly identifies non-contiguous states by filtering states where is_contiguous is False, or by excluding states from the STATES_CONTIGUOUS collection",
"max_score": 15
}
]
}