tessl install tessl/pypi-us@3.2.0A package for easily working with US and state metadata
Agent Success
Agent success rate when using this tile
88%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.24x
Baseline
Agent success rate without this tile
71%
{
"context": "This criteria evaluates the engineer's ability to use the python-us library's phonetic state name matching capability. The focus is on proper usage of the us.states.lookup() function which supports fuzzy matching through metaphone phonetic algorithms.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Import us module",
"description": "Code imports the us module or us.states submodule to access state lookup functionality",
"max_score": 10
},
{
"name": "Use lookup() function",
"description": "Code uses the us.states.lookup() function to perform state lookups with the user's query string",
"max_score": 35
},
{
"name": "Phonetic matching enabled",
"description": "Code leverages the built-in phonetic matching capability of lookup() by passing the query directly without preprocessing (does not explicitly disable phonetic matching or force exact matching)",
"max_score": 25
},
{
"name": "Access state attributes",
"description": "Code correctly accesses state object attributes (specifically 'name' and 'abbr' attributes) from the lookup result to extract required information",
"max_score": 20
},
{
"name": "Handle no match",
"description": "Code properly handles cases where lookup() returns None (no match found) and provides appropriate output or error handling",
"max_score": 10
}
]
}