CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-ai-runtime

Databricks AI Runtime, the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute. Use for: writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration.

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary operational skill body: dense, fully executable, with a validated dry-run-then-submit workflow and a smart pattern of deferring field-level detail to CLI help lookups. Its one real defect is that the twice-referenced docker-images.md is absent from the bundle, breaking the progressive-disclosure path for the custom-image flow.

Suggestions

Add the missing docker-images.md file to the bundle (e.g., under references/), or if it cannot ship, inline the essential Dockerfile/push steps and drop the dangling links in the 'Starting a run' pre-flight step and the 'Custom Docker images' section.

Add a one-line validation cue before `databricks air cancel ... --all` (e.g., run `databricks air list` first and confirm the runs about to be cancelled with the user), since it destructively kills every active run.

Update the two docker-images.md links to the final bundle-relative path (e.g., references/docker-images.md) once the file exists, so the reference resolves correctly in the packaged skill.

DimensionReasoningScore

Conciseness

Lean and dense throughout: command tables, an env-var table, a launcher-shapes table, and a consistent "the CLI's built-in help is the source of truth... Run `databricks air run -h config.<field>`" pattern that defers exhaustive field lists to runtime instead of inlining them. Not 4: there is no padded conceptual explanation — even version-sensitive details (CLI 1.20.0, nested snapshot format) are quarantined in a fallback subsection with a lookup command, and "Today's accelerator types are `GPU_1xA10` and `GPU_8xH100`; confirm with..." immediately de-risks the time-sensitive claim.

5 / 5

Actionability

Fully executable, copy-paste-ready guidance covers the common cases: session setup commands, a complete workload YAML, `databricks air run --file workload.yaml --dry-run -o json -p <profile>`, secrets scope/key creation commands, a per-framework `command:` table (torchrun/accelerate/deepspeed/composer), and logs flags (--node/--tail/--minutes/--download-to). Not 4: the examples are complete and runnable as written, including the Python snippet for reading `$HYPERPARAMETERS_PATH`.

5 / 5

Workflow Clarity

"Starting a run" is a clearly numbered 5-step sequence with explicit validation and feedback loops: pre-flight resource checks (step 3), a dry-run with "A config-validation error is a hard stop: ... show that message to the user and fix the YAML" (step 4), and idempotency-key discipline on submit (step 5); failure handling closes the loop (pull logs, surface traceback, let the user decide). Not 4: checkpoints are explicit with a fix-and-retry path, not merely implied — the peripheral `cancel --all` command appears only in a reference table, not as a walked-through workflow.

5 / 5

Progressive Disclosure

The body itself is well structured (clear overview of three flows, Docker detail correctly split out, one-level references clearly signaled as "Read [docker-images.md](docker-images.md)"), but the actual bundle contains no docker-images.md — no references/, scripts/, or such file exists anywhere in the skill directory — so both references (in the pre-flight step and the Custom Docker images section) are dangling and the "step-by-step guidance" they promise is unreachable. Not 4: a broken primary reference is more than a minor organization gap; not 2: the in-body structure and signaling are good and nothing is improperly inlined.

3 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states the domain and mechanism up front, enumerates concrete capabilities, and gives an explicit 'Use for:' trigger list covering the skill's main flows. The only weakness is slightly thin synonym coverage of natural user phrasings (e.g., 'train a model', 'GPU job').

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration" — comprehensively covering the skill's capabilities. Not 4: coverage spans every major flow of the skill with no evident gaps, matching the comprehensive anchor.

5 / 5

Completeness

Explicitly answers both: what — "submitting and managing GPU training workloads on Databricks serverless compute" via the `databricks air` CLI — and when — "Use for: writing and submitting... checking run status... streaming a run's logs..." with concrete trigger phrases. Not 4: the 'when' is not merely present but itemized and specific, matching the top anchor.

5 / 5

Trigger Term Quality

Good natural keyword coverage: "GPU training workloads", "submitting", "hyperparameters", "run status", "logs", "custom Docker image" are phrases users would naturally say. Not 5: common variations and synonyms are missing — e.g., "train a model", "training job", "GPU job", "ML experiment"; not 3: most natural terms a user would utter are present.

4 / 5

Distinctiveness Conflict Risk

Clear niche — the `databricks air` CLI for serverless GPU training on Databricks — with distinct triggers unlikely to fire for unrelated skills. Not 4: the command name plus platform plus workload type make overlap risk minimal.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 missing

Warning

Total

15

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-ai-runtime/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.