CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-homeassistant

tessl install tessl/pypi-homeassistant@2025.9.0

Open-source home automation platform running on Python 3.

Agent Success

Agent success rate when using this tile

69%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.19x

Baseline

Agent success rate without this tile

58%

rubric.jsonevals/scenario-6/

{
  "context": "This evaluation assesses the engineer's proficiency in using Home Assistant's Service Registry API to register services, invoke them, validate service data, and manage service lifecycle. The focus is on correct usage of service registry methods and integration with Home Assistant's core functionality.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Service Registration",
      "description": "Uses hass.services.async_register() to register both the alerts.notify_users and lighting.set_brightness services with appropriate service handlers.",
      "max_score": 25
    },
    {
      "name": "Schema Validation",
      "description": "Implements voluptuous schema validation for the lighting.set_brightness service to ensure brightness values are between 0-100, properly integrating the schema parameter in async_register().",
      "max_score": 20
    },
    {
      "name": "Service Invocation",
      "description": "Uses hass.services.async_call() to invoke registered services by domain and service name, correctly passing service_data as a parameter.",
      "max_score": 20
    },
    {
      "name": "Service Existence Check",
      "description": "Uses hass.services.has_service() to check whether a service is registered in a specific domain before attempting operations.",
      "max_score": 15
    },
    {
      "name": "Service Unregistration",
      "description": "Uses hass.services.async_remove() to properly unregister services from the registry when they are no longer needed.",
      "max_score": 10
    },
    {
      "name": "Async Pattern Usage",
      "description": "Correctly implements async/await patterns throughout the service manager functions, ensuring proper async execution with the Home Assistant event loop.",
      "max_score": 10
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/homeassistant@2025.9.x
tile.json