CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-pipelines

Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks. Use when building batch or streaming data pipelines with Python or SQL, including Auto CDC from event streams or periodic complete snapshots. Invoke BEFORE starting implementation.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary overview skill: token-dense product-specific guidance, concrete CLI sequences with validation checkpoints, and a clean one-level reference bundle covering every feature by language. The only refinement worth making is inlining the update-polling command and explicit edit→redeploy feedback loop instead of deferring them to references.

DimensionReasoningScore

Conciseness

The body is dense, product-specific knowledge Claude cannot know — exact validity columns ('__START_AT' / '__END_AT'), the 'dbfs:' prefix requirement for Volumes, LIVE deprecation, migration mappings — with zero padding and no explanation of concepts Claude already knows. Every line carries routing rules, traps, or concrete syntax; anti-drift check against anchor 4 finds no over-explanation to trim.

5 / 5

Actionability

Gives copy-paste-ready commands for the full lifecycle ('databricks bundle validate', 'databricks bundle deploy -t dev', 'databricks bundle run <pipeline_name> -t dev', 'databricks workspace import-dir ... --overwrite', 'databricks pipelines start-update') plus concrete read syntax ('spark.readStream.table("name")' / 'SELECT ... FROM STREAM(name)'). Minor gaps: a few details like the update-polling command are deferred to references rather than stated inline, and some entries are signature templates with placeholders.

4 / 5

Workflow Clarity

Sequences are explicit and validation is present: the DAB flow (validate → deploy → run), the CLI re-upload loop ('Re-upload ... after every change, then databricks pipelines start-update'), a dry-run feedback loop ('--validate-only'), and a destructive-operation guard (full refresh 'only when really necessary... user must explicitly select'), so no cap applies. Below anchor 5 because the update-polling procedure and error-recovery specifics are delegated to the workflow references rather than given as explicit checkpoints in the body.

4 / 5

Progressive Disclosure

The body is a genuine overview — decision tree, traps, publishing rules, a feature-to-reference API table — pointing to 33 real, verified, one-level-deep reference files organized by feature and language, with mandatory-companion reading rules ('MANDATORY: Before implementing... read its linked reference'). Cross-links inside references point only to siblings, never deeper, matching the anchor-5 structure exactly.

5 / 5

Total

18

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that clearly states both capability and trigger conditions, with excellent inclusion of the product's former name for discoverability. Minor improvements possible: qualify the 'when' clause with Databricks, add the 'DLT' acronym, and hint at the broader capability surface (sinks, expectations, migration).

DimensionReasoningScore

Specificity

Names the domain ('Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks') and several concrete capability axes — batch and streaming pipelines, Python or SQL, 'Auto CDC from event streams or periodic complete snapshots'. Minor coverage gaps: sinks, expectations, materialized views, and legacy migration are not mentioned, keeping it below the comprehensive anchor 5.

4 / 5

Completeness

Explicitly answers 'what' ('Develop Lakeflow Spark Declarative Pipelines... on Databricks') and 'when' ('Use when building batch or streaming data pipelines with Python or SQL, including Auto CDC...') with concrete trigger conditions. The additional 'Invoke BEFORE starting implementation' clause reinforces timing, matching the anchor-5 example structure.

5 / 5

Trigger Term Quality

Strong natural keywords: 'Lakeflow', 'Delta Live Tables', 'Databricks', 'batch or streaming data pipelines', 'Auto CDC', 'event streams'. Including the former product name catches users still saying it, but common variations like the acronym 'DLT' itself, 'ETL', or 'data engineering' are absent, so coverage is good rather than comprehensive.

4 / 5

Distinctiveness Conflict Risk

Product-specific names (Lakeflow, Delta Live Tables, Databricks SDP) carve out a clear niche with minimal conflict against unrelated skills. Slight overlap risk remains: the 'when' clause ('building batch or streaming data pipelines with Python or SQL') is not Databricks-qualified and could match generic Spark/pipeline skills or a databricks-core parent skill.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

skills/databricks-pipelines/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.