CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-pipelines

Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks. Use when building batch or streaming data pipelines with Python or SQL, including Auto CDC from event streams or periodic complete snapshots. Invoke BEFORE starting implementation.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is databricks-pipelines in databricks/databricks-agent-skills

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplarily structured skill body: a dense decision tree and trap list route to a well-organized flat reference bundle, with executable commands for setup and run workflows and explicit guards around destructive operations. The only room for improvement is spelling out error-recovery loops and having a touch more copy-paste-ready feature code inline.

DimensionReasoningScore

Conciseness

The body is lean and imperative throughout — a decision tree, trap list, migration table, and run sequences with no padding and no explanations of concepts Claude already knows (e.g., "Poll the update ID, not the top-level pipeline state"). All feature detail is correctly pushed to reference files, so every token earns its place, matching anchor 5.

5 / 5

Actionability

Concrete, executable guidance is abundant: the exact command sequence "databricks bundle validate", "databricks bundle deploy -t dev", "databricks bundle run <pipeline_name> -t dev", the "dbfs:/Volumes/..." CLI prefix, read syntax like "spark.readStream.table(\"name\")" / "SELECT ... FROM STREAM(name)", and precise legacy-to-modern API mappings. It is not a 5 because most feature implementation code lives in the reference files, leaving minor gaps if the body is read alone — though that split is by design.

4 / 5

Workflow Clarity

Multi-step processes are clearly sequenced with validation checkpoints: workflow A/B/C selection before scaffolding, validate → deploy → run ordering with the note that code changes only take effect after deploy, "--validate-only" dry runs, polling guidance with the cold-start "don't cancel" warning, and the destructive full refresh gated behind explicit user selection (satisfying the destructive-op cap). It falls short of anchor 5 only because error-recovery fix-retry loops for failed deploys or runs are not spelled out.

4 / 5

Progressive Disclosure

The body is a clean overview routing to 35 flat, one-level-deep reference files, all of which exist on disk and are linked with descriptive text plus a per-feature Python/SQL table. Mandatory companion-reading rules (e.g., Auto Loader → format options) and verified anchor links (temporary-view-sql.md#using-expectations-with-temporary-views resolves to a real heading) make navigation easy, matching anchor 5.

5 / 5

Total

18

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with a clear what, an explicit and concrete "Use when" trigger clause, good natural keyword coverage including the legacy product name as a synonym, and a well-scoped niche. The only weaknesses are a single primary action verb and a few missing common variations such as ETL or ingestion.

DimensionReasoningScore

Specificity

Names several concrete capabilities — "Develop Lakeflow Spark Declarative Pipelines", "building batch or streaming data pipelines with Python or SQL", "Auto CDC from event streams or periodic complete snapshots" — with only minor gaps (single primary verb; sinks, expectations, and materialized views are not surfaced). It lists more than the 1-2 concrete actions of anchor 3 but stops short of the comprehensive action list of anchor 5.

4 / 5

Completeness

Explicitly answers both questions: what ("Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks") and when ("Use when building batch or streaming data pipelines with Python or SQL, including Auto CDC from event streams or periodic complete snapshots"). This matches the anchor-5 example structure of concrete what + concrete trigger phrases.

5 / 5

Trigger Term Quality

Good natural-term coverage: "data pipelines", "batch", "streaming", "Python", "SQL", "Databricks", plus the former product name "Delta Live Tables" as a synonym. A few common variations users might say (e.g., "ETL", "ingestion", "upsert") are missing, so it falls just short of the comprehensive synonym coverage of anchor 5.

4 / 5

Distinctiveness Conflict Risk

The niche is clear and product-specific (Databricks Lakeflow/SDP with Auto CDC triggers), but the skill sits inside a Databricks skill family (parent databricks-core, sibling structured-streaming skill), so generic "streaming pipeline" phrasing carries minor overlap risk with closely related skills — anchor 4 rather than the minimal-conflict anchor 5.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-pipelines/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.