CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-homeassistant

tessl install tessl/pypi-homeassistant@2025.9.0

Open-source home automation platform running on Python 3.

Agent Success

Agent success rate when using this tile

69%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.19x

Baseline

Agent success rate without this tile

58%

rubric.jsonevals/scenario-2/

{
  "context": "This criteria evaluates how well the engineer uses Home Assistant's Event Bus System to implement an event-driven notification manager. The focus is on proper usage of event listening, firing, one-time listeners, and thread-safe event handling methods.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Event Listener Registration",
      "description": "Uses hass.bus.listen() or hass.bus.async_listen() to register a listener for state change events (EVENT_STATE_CHANGED constant or 'state_changed' string)",
      "max_score": 25
    },
    {
      "name": "Async Event Firing",
      "description": "Uses hass.bus.async_fire() to fire the 'notification_ready' event when device reaches 3 state changes, passing device name in event_data parameter",
      "max_score": 25
    },
    {
      "name": "One-Time Listener",
      "description": "Uses hass.bus.async_listen_once() to register one-time listeners for the 'notification_ready' event that automatically unregister after being triggered",
      "max_score": 25
    },
    {
      "name": "Synchronous Event Firing",
      "description": "Uses hass.bus.fire() (not async_fire) in the fire_test_event method to fire events from synchronous contexts",
      "max_score": 15
    },
    {
      "name": "State Change Tracking",
      "description": "Correctly tracks state changes by extracting entity_id from event data and maintaining a count dictionary that increments on each state change",
      "max_score": 10
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/homeassistant@2025.9.x
tile.json