CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-homeassistant

tessl install tessl/pypi-homeassistant@2025.9.0

Open-source home automation platform running on Python 3.

Agent Success

Agent success rate when using this tile

69%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.19x

Baseline

Agent success rate without this tile

58%

rubric.jsonevals/scenario-9/

{
  "context": "This criteria evaluates how well the engineer uses Home Assistant's scene management capabilities to create, activate, delete, and manage multi-entity state snapshots. Focus is on proper usage of scene services and state handling APIs.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Scene Creation Service",
      "description": "Uses the scene.create service to dynamically create scenes with entity states. Should properly construct service data with scene_id and snapshot_entities parameters.",
      "max_score": 25
    },
    {
      "name": "Scene Activation Service",
      "description": "Uses the scene.turn_on service or HomeAssistant.services.async_call to activate scenes. Should properly handle the scene entity ID and optional transition parameter.",
      "max_score": 20
    },
    {
      "name": "Scene Deletion Service",
      "description": "Uses the scene.delete service to remove dynamically created scenes. Should properly handle scene entity IDs in the format 'scene.{scene_id}'.",
      "max_score": 15
    },
    {
      "name": "Service Call Method",
      "description": "Uses hass.services.async_call method to invoke Home Assistant services with proper domain (scene), service name, and service_data parameters.",
      "max_score": 20
    },
    {
      "name": "Entity State Structure",
      "description": "Properly structures entity states with required attributes (state, brightness, temperature, etc.) and correctly formats entity IDs for the snapshot_entities parameter.",
      "max_score": 10
    },
    {
      "name": "State Retrieval",
      "description": "Uses hass.states.get or hass.states.async_all to retrieve scene entity information or verify scene existence.",
      "max_score": 10
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/homeassistant@2025.9.x
tile.json