tessl install tessl/pypi-apache-airflow-providers-dbt-cloud@4.4.0Provider package for integrating Apache Airflow with dbt Cloud for data transformation workflow orchestration
Agent Success
Agent success rate when using this tile
84%
Improvement
Agent success rate improvement when using this tile compared to baseline
1x
Baseline
Agent success rate without this tile
84%
{
"context": "This evaluation assesses the engineer's ability to use the apache-airflow-providers-dbt-cloud package to query and monitor dbt Cloud job run statuses. The focus is on correctly utilizing the DbtCloudHook methods for retrieving run status information, listing job runs, and accessing detailed run metadata.",
"type": "weighted_checklist",
"checklist": [
{
"name": "DbtCloudHook initialization",
"description": "The implementation correctly initializes a DbtCloudHook instance in the JobRunMonitor.__init__ method, passing the dbt_cloud_conn_id parameter to establish the connection.",
"max_score": 10
},
{
"name": "get_job_run_status usage",
"description": "The get_run_status method correctly uses hook.get_job_run_status() to retrieve the status code of a job run, passing the run_id and optional account_id parameters.",
"max_score": 25
},
{
"name": "list_job_runs usage",
"description": "The list_runs_for_job method correctly uses hook.list_job_runs() with the job_definition_id parameter to filter runs by job ID, and properly extracts the run data from the response objects.",
"max_score": 30
},
{
"name": "get_job_run usage",
"description": "The get_run_details method correctly uses hook.get_job_run() to retrieve detailed run information, passing run_id, account_id, and include_related parameters, and properly extracts the data from the response.",
"max_score": 25
},
{
"name": "Error handling",
"description": "The implementation includes appropriate error handling for cases where job runs cannot be found or API calls fail, as required by the get_run_status method specification.",
"max_score": 10
}
]
}