CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-pipelines

Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks. Use when building batch or streaming data pipelines with Python or SQL. Invoke BEFORE starting implementation.

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An expert-oriented, highly actionable router skill with strong trap coverage and current-vs-deprecated API mapping, weakened by broken reference-link paths in its API tables and some duplicated/vestigial material. Fixing the link prefix and consolidating the reference index would lift it substantially.

Suggestions

Fix the API table links to include the references/ prefix (e.g. references/streaming-table/streaming-table-python.md → references/streaming-table-python.md); as written, dozens of table links resolve to non-existent paths.

Remove the vestigial '## Language-specific guides' section, which contains only one definitional sentence, and merge the duplicate ST-vs-MV aggregation guidance in 'Common Traps' into a single bullet.

Consider moving the six API comparison tables into a single reference file and having SKILL.md link to it, eliminating the duplicate reference index (tables vs. 'Pipeline API Reference' section).

DimensionReasoningScore

Conciseness

The body is dense and expert-facing — decision tree, traps, current-vs-deprecated API tables — assuming Claude already knows Spark and Databricks. Minor trimmable instances remain: the vestigial '## Language-specific guides' heading holds only one definitional sentence ("is a framework for building batch or streaming data pipelines") explaining a concept Claude doesn't need, and the ST-vs-MV aggregation guidance is restated across two adjacent Common Traps bullets.

4 / 5

Actionability

Fully executable throughout: a copy-paste `databricks bundle init` command with a concrete --config-file payload, an exact `resources/*.job.yml` scheduling snippet, exact decorators/SQL for every feature (e.g. `@dp.append_flow(once=True)`, `CREATE OR REFRESH PRIVATE STREAMING TABLE`), and a four-step numbered workflow with literal commands. Specific examples cover the common cases.

5 / 5

Workflow Clarity

The Development Workflow is a clear sequence (Validate → Deploy → Run → Check status) with a critical checkpoint ("You must deploy before running") and destructive-operation guarding (full refresh is "the most expensive and dangerous option, and can lead to data loss" and must be explicitly user-selected). Missing an explicit error-recovery loop (what to do when `bundle validate` fails), so it sits at anchor 4 rather than 5.

4 / 5

Progressive Disclosure

Bundle structure is real and the final 'Pipeline API Reference' section links correctly one level deep into references/, but every link inside the six API comparison tables (e.g. `[streaming-table-python](streaming-table/streaming-table-python.md)`) omits the `references/` prefix and points to non-existent subdirectories — broken navigation for a large portion of the file. Those tables also duplicate the reference index inline rather than pointing to it, fitting anchor 3 ('references present but not clearly signaled; content that should be separate is inline') better than anchor 4.

3 / 5

Total

16

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: precise domain naming with the important rename synonym, third-person voice, and an explicit 'Use when' trigger clause. It is slightly thin on enumerated capabilities and misses the 'DLT' abbreviation users commonly type.

DimensionReasoningScore

Specificity

Names the domain precisely ("Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks") and one concrete action ("Develop"), plus the languages ("Python or SQL"), but lists no finer-grained capabilities. This matches the anchor 'Names domain and 1-2 concrete actions, but not comprehensive' — not score 4, which requires several specific actions listed.

3 / 5

Completeness

Explicitly answers both questions: what ("Develop Lakeflow Spark Declarative Pipelines ... on Databricks") and when ("Use when building batch or streaming data pipelines with Python or SQL. Invoke BEFORE starting implementation"). The trigger phrases are concrete and imperative, matching the anchor-5 example structure.

5 / 5

Trigger Term Quality

Good natural-term coverage: "data pipelines", "batch or streaming", "Python or SQL", and the rename synonym "formerly Delta Live Tables". A few natural terms users actually type are missing — notably the abbreviation "DLT", "Auto Loader", and " Expectations" — so it falls just below the comprehensive-synonym anchor 5.

4 / 5

Distinctiveness Conflict Risk

A clear niche (Lakeflow/DLT pipelines on Databricks, distinct from the parent databricks-core CLI skill) with distinct triggers ("batch or streaming data pipelines", pipeline naming, and the Delta Live Tables synonym). Minimal conflict risk with generic data-processing skills.

5 / 5

Total

17

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 52 missing

Warning

Total

14

/

16

Passed

Repository

databricks/devhub

Path

.agents/skills/databricks-pipelines/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.