tessl install tessl/pypi-apache-airflow-providers-dbt-cloud@4.4.0Provider package for integrating Apache Airflow with dbt Cloud for data transformation workflow orchestration
Agent Success
Agent success rate when using this tile
84%
Improvement
Agent success rate improvement when using this tile compared to baseline
1x
Baseline
Agent success rate without this tile
84%
{
"context": "This evaluation assesses how well the engineer uses the apache-airflow-providers-dbt-cloud package to correctly handle dbt Cloud's multi-version API architecture. The focus is on proper API version selection (V2 vs V3) for different resource types and correct usage of the package's underlying capabilities.",
"type": "weighted_checklist",
"checklist": [
{
"name": "DbtCloudHook usage",
"description": "Uses DbtCloudHook from airflow.providers.dbt.cloud.hooks.dbt for API interactions rather than implementing raw HTTP requests",
"max_score": 25
},
{
"name": "V3 project retrieval",
"description": "Uses get_project method from DbtCloudHook or correctly calls the V3 API endpoint (/api/v3/accounts/{account_id}/projects/{project_id}/) for project operations",
"max_score": 15
},
{
"name": "V3 environment listing",
"description": "Uses list_environments method from DbtCloudHook or correctly calls the V3 API endpoint (/api/v3/accounts/{account_id}/projects/{project_id}/environments/) for environment operations",
"max_score": 15
},
{
"name": "V2 job retrieval",
"description": "Uses get_job method from DbtCloudHook or correctly calls the V2 API endpoint (/api/v2/accounts/{account_id}/jobs/{job_id}/) for job operations",
"max_score": 15
},
{
"name": "V2 run retrieval",
"description": "Uses get_job_run or get_job_run_status methods from DbtCloudHook or correctly calls the V2 API endpoint (/api/v2/accounts/{account_id}/runs/{run_id}/) for run operations",
"max_score": 15
},
{
"name": "Connection management",
"description": "Properly initializes DbtCloudHook with connection configuration including account_id and uses the hook's built-in authentication handling",
"max_score": 10
},
{
"name": "Response handling",
"description": "Correctly extracts and returns data from the API responses, handling the JSON structure returned by the hook methods",
"max_score": 5
}
]
}