tessl install tessl/pypi-us@3.2.0A package for easily working with US and state metadata
Agent Success
Agent success rate when using this tile
88%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.24x
Baseline
Agent success rate without this tile
71%
{
"context": "This criteria evaluates how effectively the engineer uses the python-us package's FIPS code lookup functionality to validate state codes and retrieve state information. The focus is on correct usage of the package's lookup API with FIPS codes.",
"type": "weighted_checklist",
"checklist": [
{
"name": "FIPS lookup usage",
"description": "Uses the us.states.lookup() function to look up states by FIPS code",
"max_score": 40
},
{
"name": "State object attributes",
"description": "Correctly accesses the 'name' and 'abbr' attributes from State objects returned by lookup()",
"max_score": 25
},
{
"name": "FIPS code handling",
"description": "Correctly passes FIPS codes as strings to lookup() and accesses the 'fips' attribute from State objects",
"max_score": 20
},
{
"name": "Territory support",
"description": "Solution works for both states and territories (lookup handles both by default)",
"max_score": 10
},
{
"name": "Invalid code handling",
"description": "Properly handles None return values from lookup() when FIPS codes are invalid",
"max_score": 5
}
]
}