tessl install tessl/pypi-homeassistant@2025.9.0Open-source home automation platform running on Python 3.
Agent Success
Agent success rate when using this tile
69%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.19x
Baseline
Agent success rate without this tile
58%
{
"context": "This criteria evaluates how well the engineer uses Home Assistant's scene management capabilities to create, activate, delete, and manage multi-entity state snapshots. Focus is on proper usage of scene services and state handling APIs.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Scene Creation Service",
"description": "Uses the scene.create service to dynamically create scenes with entity states. Should properly construct service data with scene_id and snapshot_entities parameters.",
"max_score": 25
},
{
"name": "Scene Activation Service",
"description": "Uses the scene.turn_on service or HomeAssistant.services.async_call to activate scenes. Should properly handle the scene entity ID and optional transition parameter.",
"max_score": 20
},
{
"name": "Scene Deletion Service",
"description": "Uses the scene.delete service to remove dynamically created scenes. Should properly handle scene entity IDs in the format 'scene.{scene_id}'.",
"max_score": 15
},
{
"name": "Service Call Method",
"description": "Uses hass.services.async_call method to invoke Home Assistant services with proper domain (scene), service name, and service_data parameters.",
"max_score": 20
},
{
"name": "Entity State Structure",
"description": "Properly structures entity states with required attributes (state, brightness, temperature, etc.) and correctly formats entity IDs for the snapshot_entities parameter.",
"max_score": 10
},
{
"name": "State Retrieval",
"description": "Uses hass.states.get or hass.states.async_all to retrieve scene entity information or verify scene existence.",
"max_score": 10
}
]
}