tessl install tessl/pypi-homeassistant@2025.9.0Open-source home automation platform running on Python 3.
Agent Success
Agent success rate when using this tile
69%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.19x
Baseline
Agent success rate without this tile
58%
{
"context": "This evaluation assesses the engineer's proficiency in using Home Assistant's Service Registry API to register services, invoke them, validate service data, and manage service lifecycle. The focus is on correct usage of service registry methods and integration with Home Assistant's core functionality.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Service Registration",
"description": "Uses hass.services.async_register() to register both the alerts.notify_users and lighting.set_brightness services with appropriate service handlers.",
"max_score": 25
},
{
"name": "Schema Validation",
"description": "Implements voluptuous schema validation for the lighting.set_brightness service to ensure brightness values are between 0-100, properly integrating the schema parameter in async_register().",
"max_score": 20
},
{
"name": "Service Invocation",
"description": "Uses hass.services.async_call() to invoke registered services by domain and service name, correctly passing service_data as a parameter.",
"max_score": 20
},
{
"name": "Service Existence Check",
"description": "Uses hass.services.has_service() to check whether a service is registered in a specific domain before attempting operations.",
"max_score": 15
},
{
"name": "Service Unregistration",
"description": "Uses hass.services.async_remove() to properly unregister services from the registry when they are no longer needed.",
"max_score": 10
},
{
"name": "Async Pattern Usage",
"description": "Correctly implements async/await patterns throughout the service manager functions, ensuring proper async execution with the Home Assistant event loop.",
"max_score": 10
}
]
}