tessl install tessl/npm-lightdash--common@0.2231.5Shared TypeScript library for the Lightdash platform containing common types, utilities, and business logic for analytics workflows
Agent Success
Agent success rate when using this tile
72%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.09x
Baseline
Agent success rate without this tile
66%
{
"context": "This criteria evaluates how well the engineer uses the @lightdash/common package's email and organization validation utilities. The focus is on correct usage of the package's API functions for extracting email domains, validating organization names, and checking organization domains against public email providers.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses getEmailDomain",
"description": "Uses the getEmailDomain() function from @lightdash/common to extract the domain from an email address in the extractEmailDomain() implementation",
"max_score": 30
},
{
"name": "Uses validateOrganizationName",
"description": "Uses the validateOrganizationName() function from @lightdash/common to check organization name validity in the isValidOrganizationName() implementation",
"max_score": 30
},
{
"name": "Uses validateOrganizationEmailDomains",
"description": "Uses the validateOrganizationEmailDomains() function from @lightdash/common to validate organization email domains in the checkOrganizationDomains() implementation",
"max_score": 30
},
{
"name": "Proper error handling",
"description": "Correctly propagates errors from getEmailDomain() in extractEmailDomain() without suppressing or mishandling them",
"max_score": 10
}
]
}docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10
scenario-11
scenario-12
scenario-13
scenario-14
scenario-15
scenario-16
scenario-17
scenario-18
scenario-19
scenario-20