or run

tessl search
Log in

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/apache-airflow-backport-providers-apache-sqoop@2021.3.x
tile.json

tessl/pypi-apache-airflow-backport-providers-apache-sqoop

tessl install tessl/pypi-apache-airflow-backport-providers-apache-sqoop@2021.3.0

Apache Airflow backport provider package for Apache Sqoop integration, providing SqoopHook and SqoopOperator for data import/export between relational databases and Hadoop

Agent Success

Agent success rate when using this tile

92%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.39x

Baseline

Agent success rate without this tile

66%

rubric.jsonevals/scenario-3/

{
  "context": "Evaluates how the solution uses Apache Airflow's Sqoop provider to build a templated import/export DAG with correct filtering, null handling, dependencies, and safe cancellation for Sqoop subprocesses.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Sqoop import task",
      "description": "Uses SqoopOperator (cmd_type=\"import\") with the provided conn_id and either table or query params to pull source_table rows, sets split_by for mapper parallelism, and writes to a target_dir built from hdfs_import_dir and run context.",
      "max_score": 30
    },
    {
      "name": "Templated filtering",
      "description": "Import command renders its WHERE or query filter with Jinja macros (e.g., ds/ds_nodash) rather than hardcoded dates, and includes the required $CONDITIONS placeholder when using query mode so Sqoop applies mapper predicates correctly.",
      "max_score": 20
    },
    {
      "name": "Export configuration",
      "description": "Uses SqoopOperator (cmd_type=\"export\") pointing at export_dir and target_table, runs in batch mode, and sets input_null_string plus input_null_non_string to apply the expected null sentinels during export.",
      "max_score": 25
    },
    {
      "name": "Task dependency",
      "description": "Defines the export SqoopOperator downstream of the import SqoopOperator using Airflow dependencies so a failed import prevents export execution (default trigger_rule behavior is preserved).",
      "max_score": 10
    },
    {
      "name": "Kill handling",
      "description": "Implements or leverages SqoopOperator.on_kill to terminate the underlying SqoopHook subprocess (popen) when the task is cancelled, avoiding orphaned Sqoop jobs.",
      "max_score": 15
    }
  ]
}