CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-homeassistant

tessl install tessl/pypi-homeassistant@2025.9.0

Open-source home automation platform running on Python 3.

Agent Success

Agent success rate when using this tile

69%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.19x

Baseline

Agent success rate without this tile

58%

rubric.jsonevals/scenario-8/

{
  "context": "This evaluation assesses how well the engineer uses Home Assistant's State Machine API to manage entity states. The focus is on proper usage of the state management methods (async_set, get, async_remove, async_all) from the hass.states object.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses hass.states",
      "description": "Uses the hass.states object (the State Machine) to access state management functionality rather than attempting to implement custom state storage",
      "max_score": 20
    },
    {
      "name": "async_set usage",
      "description": "Uses hass.states.async_set() method correctly to create and update entity states with entity_id, state value, and attributes",
      "max_score": 25
    },
    {
      "name": "get method usage",
      "description": "Uses hass.states.get() method to retrieve entity states by entity_id, correctly handling the return of State objects or None",
      "max_score": 20
    },
    {
      "name": "async_remove usage",
      "description": "Uses hass.states.async_remove() method to remove entity states from the state machine",
      "max_score": 15
    },
    {
      "name": "async_all usage",
      "description": "Uses hass.states.async_all() method to retrieve all tracked entity states as a list",
      "max_score": 15
    },
    {
      "name": "Async/await pattern",
      "description": "Correctly uses async/await pattern for async state machine methods (async_set, async_remove, async_all) while not using await with synchronous get()",
      "max_score": 5
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/homeassistant@2025.9.x
tile.json