incremental-load-setup

Incremental Load Setup - Auto-activating skill for Data Pipelines. Triggers on: incremental load setup, incremental load setup Part of the Data Pipelines skill category.

1.04x

Quality

Does it follow best practices?

Impact

96%

1.04x

Average score across 3 eval scenarios

Securityby

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./planned-skills/generated/11-data-pipelines/incremental-load-setup/SKILL.md

Evaluation results

98%

Daily Transaction Incremental Load Pipeline

Airflow incremental ETL with watermarking

Criteria

Without context

With context

Watermark mechanism

100%

Watermark persistence

100%

Incremental filter query

100%

Idempotent operation

100%

Error handling / retries

75%

Airflow DAG structure

100%

Parameterised connection

100%

Validate script present

100%

Step-by-step documentation

100%

Production config present

100%

Without context: $0.4136 · 2m 10s · 20 turns · 22 in / 7,135 out tokens

With context: $0.6776 · 2m 44s · 31 turns · 30 in / 10,714 out tokens

92%

Log Processing Incremental Load with Spark

Spark incremental batch load with checkpointing

Criteria

Without context

With context

Checkpoint / state tracking

100%

Incremental file filtering

100%

Idempotent output

41%

50%

PySpark framework used

100%

Production SparkSession config

87%

100%

Error handling

37%

75%

Parquet output

100%

Schema validation script

100%

Sample input file

100%

Checkpoint updated after run

100%

Without context: $0.3580 · 2m 34s · 21 turns · 21 in / 6,300 out tokens

With context: $0.7454 · 3m 48s · 38 turns · 301 in / 9,143 out tokens

99%

CSV-Based Incremental Load: Setup and Validation

Step-by-step incremental ETL setup with output validation

Criteria

Without context

With context

Upsert / merge logic

100%

Incremental state awareness

100%

Deduplication

100%

Validation script — column check

100%

Validation script — null check

100%

Validation script — duplicate check

100%

Step-by-step setup guide

100%

Sample data files

100%

Run log present

100%

Production error handling

71%

85%

Without context: $0.7204 · 2m 50s · 35 turns · 36 in / 10,400 out tokens

With context: $0.6717 · 2m 18s · 35 turns · 328 in / 9,263 out tokens

Repository: jeremylongshore/claude-code-plugins-plus-skills
Commit: 0c08951

Evaluated: 18 days ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Daily Transaction Incremental Load Pipeline Log Processing Incremental Load with Spark CSV-Based Incremental Load: Setup and Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.