CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-ai-runtime

Databricks AI Runtime, the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute. Use for: writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration.

71

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-crafted, highly actionable skill body: executable examples dominate, the main workflow has real validation checkpoints and error-recovery loops, and detail is properly pushed to a referenced file. The dings are small — a duplicated flattened/nested `code_source` explanation, no caution around the destructive `cancel --all`, and a referenced docker-images.md that is missing from the bundle.

Suggestions

Add validation guidance around the destructive batch operation: before `databricks air cancel ... --all`, list active runs (`databricks air list`) and confirm with the user, mirroring the careful hard-stop treatment the dry-run step already gets.

Ship docker-images.md with the skill bundle or fix the link — the body points to it twice (pre-flight checks and the Custom Docker images section) but no such file exists in the bundle, so both references dangle.

Consolidate the flattened vs nested `code_source` guidance into one place (Workload YAML) and have the Session setup section reference it, removing the duplicated explanation.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence — it never explains what distributed training, MLflow, or Docker are, and every table (env vars, error kinds, framework launch shapes) carries CLI-specific information Claude could not know. Minor trimming is possible: the flattened vs nested `code_source` guidance is covered in both the Session setup and Workload YAML sections, and a few meta sentences ("This skill covers the three everyday flows") could be tightened. Not 5 because of that duplication; not 3 because padding is minimal and no known concepts are re-explained.

4 / 5

Actionability

Fully executable throughout: complete workload YAML with comments, exact commands with flags (`databricks air run --file workload.yaml --dry-run -o json -p <profile>`), a copy-paste framework table of `command:` shapes (torchrun/accelerate/deepspeed/composer), a Python snippet for reading `$HYPERPARAMETERS_PATH`, secrets-creation commands, and a concrete idempotency-key format. This matches the score-5 anchor: copy-paste ready code covering the common cases.

5 / 5

Workflow Clarity

The "Starting a run" flow is a numbered 5-step sequence with explicit validation checkpoints (pre-flight secrets/image checks, a `--dry-run` hard stop with error-handling instructions) and feedback loops (the error `kind` table mapping errors to actions, and "If a run fails" → pull logs → surface traceback → user decides). The minor gap: `databricks air cancel ... --all` is a destructive batch operation listed in the Subcommands table with no confirmation guidance, which keeps this just below anchor 5.

4 / 5

Progressive Disclosure

Good structure: the main flows (submit, check, monitor, fail) live in SKILL.md and deep Docker-image material is correctly split out behind a clearly signaled, one-level-deep reference ("Read [docker-images.md](docker-images.md) for step-by-step guidance on: …"). However, scoring against the actual bundle: no `references/` or `scripts/` directories exist, and the referenced `docker-images.md` is not present in the bundle, so the link is dangling as packaged — a minor organization gap that keeps this below anchor 5.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it names the exact CLI subcommand, enumerates concrete capabilities comprehensively, and provides an explicit "Use for:" trigger clause. The only minor gap is that a few natural user phrasings (e.g. "train a model on Databricks") are absent from the trigger list.

DimensionReasoningScore

Specificity

The description lists multiple specific concrete actions: "writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration" — comprehensive coverage of the CLI's action surface, matching the score-5 anchor.

5 / 5

Completeness

Explicitly answers both questions: what ("the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute") and when ("Use for: writing and submitting workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming logs…") with concrete trigger phrases, exactly matching the score-5 anchor.

5 / 5

Trigger Term Quality

Good natural keyword coverage ("GPU training workloads", "run status", "streaming logs", "hyperparameters and secrets", "Docker image", "workload YAML"), but a few natural user phrasings are missing (e.g. "train a model on Databricks", "serverless training", "GPU job"). Falls between anchor 4 (good coverage, a few natural terms missing) and 5 (comprehensive synonyms); 4 fits best.

4 / 5

Distinctiveness Conflict Risk

Clear niche: the `databricks air` subcommand for GPU training on Databricks serverless compute, with distinct trigger terms (workload YAML, run status, `databricks air` logs) that are unlikely to fire for unrelated skills; minimal conflict risk even against a general Databricks CLI skill.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 missing

Warning

Total

15

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/claude/skills/databricks-ai-runtime/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.