tessl install tessl/npm-lightdash--common@0.2231.5Shared TypeScript library for the Lightdash platform containing common types, utilities, and business logic for analytics workflows
Agent Success
Agent success rate when using this tile
72%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.09x
Baseline
Agent success rate without this tile
66%
{
"context": "This evaluation assesses how effectively the engineer utilizes the @lightdash/common package for parsing dbt manifest files and extracting model metadata. The focus is on proper use of package-provided types, parsing functions, and data structures specific to dbt manifest handling.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Manifest Type Usage",
"description": "Uses @lightdash/common's DbtManifest or similar manifest type definitions from the package instead of defining custom manifest types from scratch",
"max_score": 25
},
{
"name": "Model Node Types",
"description": "Uses @lightdash/common's DbtNode, DbtModelNode, or equivalent type definitions for representing dbt models from the manifest nodes",
"max_score": 20
},
{
"name": "Column Metadata Types",
"description": "Uses @lightdash/common's DbtColumn or similar column type definitions for extracting column metadata (name, type, description)",
"max_score": 15
},
{
"name": "Manifest Parsing Functions",
"description": "Leverages any parsing utilities or helper functions from @lightdash/common for processing manifest structure rather than implementing custom JSON traversal logic",
"max_score": 20
},
{
"name": "Model Filtering Logic",
"description": "Uses @lightdash/common utilities or type guards to correctly identify and filter model nodes from the manifest's nodes collection (models vs. other node types like tests, sources, etc.)",
"max_score": 15
},
{
"name": "Package Import Strategy",
"description": "Properly imports relevant types and utilities from @lightdash/common using appropriate import statements",
"max_score": 5
}
]
}docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10
scenario-11
scenario-12
scenario-13
scenario-14
scenario-15
scenario-16
scenario-17
scenario-18
scenario-19
scenario-20