or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/us@3.2.x
tile.json

tessl/pypi-us

tessl install tessl/pypi-us@3.2.0

A package for easily working with US and state metadata

Agent Success

Agent success rate when using this tile

88%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.24x

Baseline

Agent success rate without this tile

71%

rubric.jsonevals/scenario-1/

{
  "context": "This evaluation assesses the engineer's ability to use the python-us package's geographic attribute filtering capabilities, specifically the is_contiguous and is_continental attributes. The focus is on correctly leveraging the package's built-in state collections and geographic boolean attributes to filter US states.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses us package",
      "description": "Imports and uses the 'us' package (specifically us.states module) to access state data",
      "max_score": 10
    },
    {
      "name": "Uses STATES collection",
      "description": "Uses the us.states.STATES collection, us.states.STATES_CONTIGUOUS, us.states.STATES_CONTINENTAL, or us.states.STATES_AND_TERRITORIES to access state data",
      "max_score": 15
    },
    {
      "name": "Accesses contiguous states",
      "description": "Correctly accesses contiguous states either by using the is_contiguous boolean attribute on state objects OR by directly using the us.states.STATES_CONTIGUOUS collection",
      "max_score": 30
    },
    {
      "name": "Accesses continental states",
      "description": "Correctly accesses continental states either by using the is_continental boolean attribute on state objects OR by directly using the us.states.STATES_CONTINENTAL collection",
      "max_score": 30
    },
    {
      "name": "Accesses non-contiguous states",
      "description": "Correctly identifies non-contiguous states by filtering states where is_contiguous is False, or by excluding states from the STATES_CONTIGUOUS collection",
      "max_score": 15
    }
  ]
}