CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-lakeflow-connect

Build managed ingestion pipelines into Databricks using Lakeflow Connect. Use when ingesting from SaaS apps (Salesforce, Workday Reports, ServiceNow, Google Analytics 4, HubSpot, Confluence) or databases (SQL Server cloud and on-prem; PostgreSQL/MySQL CDC in PuPr) into Unity Catalog with serverless pipelines.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable skill body: executable CLI/JSON examples, explicit wrong-vs-right anti-patterns, and an excellent one-level-deep reference layout with a purpose-labeled navigation table. The main gaps are a small amount of marketing-style framing, time-sensitive version pins outside a freshness section, and a couple of deferred or missing concrete examples (DAB YAML, connections create, Jobs schedule) plus an inline verify-data-landed checkpoint.

Suggestions

Trim or compress the 'three frames' bullets in 'What Is Lakeflow Connect?' into a single sentence — the framing language ('Simple and low-maintenance', 'Unified with the lakehouse') adds tokens without adding actionable information.

Add a minimal inline example for the two deferred common cases: a one-resource DAB YAML snippet for the pipeline and a Jobs 'pipeline_task' schedule block, both of which the workflow tells the reader to use but never shows.

Close the workflow with an explicit validation checkpoint (e.g., query the event log or destination table row counts after the first run, with a pointer to the fix-and-retry guidance in 5-troubleshooting-and-monitoring.md) so the batch ingestion loop ends in verification rather than deferral.

DimensionReasoningScore

Conciseness

The body is dense and product-specific — it explains only things Claude cannot know (ingestion_definition vs libraries, triggered-only mode, gateway staging) and assumes competence elsewhere. It falls short of anchor 5 because the "three frames" section ("Simple and low-maintenance", "Unified with the lakehouse") reads as marketing framing, and version pins ("CLI v0.294.0+", "databricks-sdk>=0.85.0") sit outside any deprecated/freshness section, per the time-sensitive-information guideline.

4 / 5

Actionability

Concrete, copy-paste-ready commands dominate: the full "databricks pipelines create --json" payload, "bundle deploy" / "bundle run", the start-update/get-update/list-updates polling set, and WRONG/RIGHT anti-pattern JSON. Not anchor 5 because several common cases are deferred rather than shown — no DAB YAML snippet, no "databricks connections create" example, and the Jobs scheduling step has no command — leaving minor gaps.

4 / 5

Workflow Clarity

The 6-step workflow is clearly sequenced with most checkpoints present: prerequisite verification (step 2), event-log watch on first run (step 5), and an explicit ready-check ("resume once 'databricks connections get <connection_name>' reports 'READY'"). It misses anchor 5 because final validation that data actually landed is only pointed at via reference 5 rather than stated as an inline checkpoint, and no fix-and-retry loop is shown for a failed first run.

4 / 5

Progressive Disclosure

The SKILL.md is a true overview: a "Detailed guides" table with a "When to read" column, and a connector catalog routing each source to its file. All four referenced files exist and are one level deep (they link only back to SKILL.md and to siblings, never onward to further files), matching the clear-overview anchor exactly. The unused assets/ images and the 1-2-4-5 filename gap are negligible.

5 / 5

Total

17

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly states what the skill does and when to use it, anchored by a literal 'Use when' clause enumerating the exact source systems a user would name. Trigger-term coverage is comprehensive for the domain. The only room for improvement is naming one or two additional concrete actions (e.g., scheduling or credential handling) and sharpening the database-ingestion boundary against sibling ingestion skills.

DimensionReasoningScore

Specificity

"Build managed ingestion pipelines into Databricks using Lakeflow Connect" names the concrete action, tool, destination ("into Unity Catalog"), and compute model ("serverless pipelines"), with a specific source list. It stops short of anchor 5 because only one verb is expressed — credential setup, scheduling, and schema-evolution capabilities are absent — but it is noticeably above the 1-2-action midpoint of anchor 3.

4 / 5

Completeness

Both halves are explicit: the what is "Build managed ingestion pipelines into Databricks using Lakeflow Connect" and the when is "Use when ingesting from SaaS apps (...) or databases (...) into Unity Catalog with serverless pipelines" — a literal 'Use when' clause with concrete trigger phrases, exactly the anchor-5 pattern. Not 4, because the 'when' is fully explicit rather than merely serviceable.

5 / 5

Trigger Term Quality

"ingesting from SaaS apps (Salesforce, Workday Reports, ServiceNow, Google Analytics 4, HubSpot, Confluence) or databases (SQL Server... PostgreSQL/MySQL CDC)" covers the natural terms users would actually say — source-system names verbatim — plus synonyms like "ingesting" and "SaaS apps". This matches the comprehensive-coverage anchor; no natural phrasing for this domain is missing.

5 / 5

Distinctiveness Conflict Risk

Named SaaS apps (Salesforce, HubSpot, Confluence, etc.) are distinct triggers that would not fire sibling skills, giving a clear niche. However "databases... into Unity Catalog" shares territory with closely related skills (Auto Loader pipelines, Lakehouse Federation), which is exactly anchor 4's "minor overlap risk with closely related skills" rather than anchor 5's minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-lakeflow-connect/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.