CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-homeassistant

tessl install tessl/pypi-homeassistant@2025.9.0

Open-source home automation platform running on Python 3.

Agent Success

Agent success rate when using this tile

69%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.19x

Baseline

Agent success rate without this tile

58%

rubric.jsonevals/scenario-3/

{
  "context": "This criteria evaluates how well the engineer uses Home Assistant's Automation Engine capabilities to implement a multi-trigger automation system with state changes, time-based conditions, event handling, and action sequences.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "State Change Triggers",
      "description": "Uses state change triggers correctly for motion and temperature sensors (e.g., platform: state with entity_id and to/from conditions, or uses async_track_state_change_event)",
      "max_score": 20
    },
    {
      "name": "Time-Based Conditions",
      "description": "Implements time-based conditions to check if current time is between 6 PM and 11 PM (e.g., using condition: time with after/before parameters, or template conditions with now())",
      "max_score": 15
    },
    {
      "name": "Numeric State Conditions",
      "description": "Uses numeric state conditions or comparisons to check light level and temperature thresholds (e.g., condition: numeric_state or template conditions with state comparison)",
      "max_score": 15
    },
    {
      "name": "Event Triggers",
      "description": "Implements event listening for custom override events (e.g., platform: event in trigger configuration, or hass.bus.async_listen)",
      "max_score": 15
    },
    {
      "name": "Condition Evaluation",
      "description": "Properly chains multiple conditions using logical operators (e.g., condition: and/or with multiple sub-conditions, or async_condition_from_config)",
      "max_score": 10
    },
    {
      "name": "Service Calls",
      "description": "Executes actions by calling services for lights and climate control (e.g., hass.services.async_call or service: light.turn_on/climate.set_temperature in action configuration)",
      "max_score": 10
    },
    {
      "name": "Automation Configuration",
      "description": "Properly structures automation config with trigger, condition, and action sections (e.g., creating dict with these keys or using automation.async_register)",
      "max_score": 8
    },
    {
      "name": "Automation Mode",
      "description": "Configures automation mode to handle concurrent triggers (e.g., setting mode to 'single', 'restart', 'queued', or 'parallel' in automation config)",
      "max_score": 5
    },
    {
      "name": "Delayed Re-enabling",
      "description": "Implements delayed re-enabling after override event (e.g., using delay in action, async_call_later, or automation enable/disable services)",
      "max_score": 2
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/homeassistant@2025.9.x
tile.json