tessl install tessl/pypi-homeassistant@2025.9.0Open-source home automation platform running on Python 3.
Agent Success
Agent success rate when using this tile
69%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.19x
Baseline
Agent success rate without this tile
58%
{
"context": "This criteria evaluates how well the engineer uses Home Assistant's Automation Engine capabilities to implement a multi-trigger automation system with state changes, time-based conditions, event handling, and action sequences.",
"type": "weighted_checklist",
"checklist": [
{
"name": "State Change Triggers",
"description": "Uses state change triggers correctly for motion and temperature sensors (e.g., platform: state with entity_id and to/from conditions, or uses async_track_state_change_event)",
"max_score": 20
},
{
"name": "Time-Based Conditions",
"description": "Implements time-based conditions to check if current time is between 6 PM and 11 PM (e.g., using condition: time with after/before parameters, or template conditions with now())",
"max_score": 15
},
{
"name": "Numeric State Conditions",
"description": "Uses numeric state conditions or comparisons to check light level and temperature thresholds (e.g., condition: numeric_state or template conditions with state comparison)",
"max_score": 15
},
{
"name": "Event Triggers",
"description": "Implements event listening for custom override events (e.g., platform: event in trigger configuration, or hass.bus.async_listen)",
"max_score": 15
},
{
"name": "Condition Evaluation",
"description": "Properly chains multiple conditions using logical operators (e.g., condition: and/or with multiple sub-conditions, or async_condition_from_config)",
"max_score": 10
},
{
"name": "Service Calls",
"description": "Executes actions by calling services for lights and climate control (e.g., hass.services.async_call or service: light.turn_on/climate.set_temperature in action configuration)",
"max_score": 10
},
{
"name": "Automation Configuration",
"description": "Properly structures automation config with trigger, condition, and action sections (e.g., creating dict with these keys or using automation.async_register)",
"max_score": 8
},
{
"name": "Automation Mode",
"description": "Configures automation mode to handle concurrent triggers (e.g., setting mode to 'single', 'restart', 'queued', or 'parallel' in automation config)",
"max_score": 5
},
{
"name": "Delayed Re-enabling",
"description": "Implements delayed re-enabling after override event (e.g., using delay in action, async_call_later, or automation enable/disable services)",
"max_score": 2
}
]
}