CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

databricks-ai-runtime

Databricks AI Runtime, the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute. Use for: writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is databricks-ai-runtime in databricks/databricks-agent-skills

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable and workflow-strong: exact commands, complete YAML, a validated submit pipeline, and explicit error-recovery guidance. The significant defect is that both references to docker-images.md point to a file that is missing from the bundle, so the deferred custom-image guidance is unreachable; minor trimming of inline version-sensitive values would also help.

Suggestions

Add the missing docker-images.md to the bundle (e.g., under references/) or inline its essential steps — the body links to it twice (in 'Starting a run' step 3 and 'Custom Docker images') but the file does not exist, so the deferred guidance is unreachable.

Consolidate time-sensitive values (accelerator types like GPU_1xA10/GPU_8xH100 and the CLI 1.20.0 version thresholds) into a single compatibility section, since they are currently scattered inline across Session setup, Workload YAML, and the frontmatter.

Trim the opening paragraph, which restates the frontmatter description almost verbatim, and consider moving the node environment-variable table to a reference file now that the bundle will have one.

DimensionReasoningScore

Conciseness

The body is dense with platform-specific facts Claude cannot know (error-kind action table, node env-var table, dry-run flag, idempotency-key discipline) and avoids explaining general concepts, fitting the "efficient; minor instances of over-explanation" anchor. It is not score 5 because time-sensitive values appear inline outside any compatibility/deprecated section — "Today's accelerator types are `GPU_1xA10` and `GPU_8xH100`" and repeated CLI 1.20.0 version references — and the opening paragraph re-states the frontmatter description.

4 / 5

Actionability

Guidance is fully executable throughout: exact commands ("databricks air run --file workload.yaml --dry-run -o json -p <profile>", secrets create-scope/put-secret), complete YAML blocks, a torchrun/accelerate/deepspeed command-shape table, and a working Python snippet for reading $HYPERPARAMETERS_PATH. Copy-paste ready commands cover the common cases, matching the top anchor.

5 / 5

Workflow Clarity

"Starting a run" is a clearly sequenced 5-step process with explicit validation checkpoints — step 3 pre-flights referenced resources ("confirm every `secrets` scope/key exists") and step 4 mandates a dry-run where a config-validation error is "a hard stop... fix the YAML" — plus an error-kind table prescribing recovery actions and an "If a run fails" section. This matches the anchor requiring explicit validation steps and feedback loops for error recovery.

5 / 5

Progressive Disclosure

Sections are well-organized and the body defers bulk custom-image material to a clearly signaled reference ("Read [docker-images.md](docker-images.md)") rather than inlining it. However, no docker-images.md exists anywhere in the bundle (references/ and scripts/ are absent; assets/ holds only unreferenced databricks.png/.svg images), so the sole progressive-disclosure path is broken — the deferred guidance is unreachable. Per the guideline to score against the actual bundle structure, this fits the score-3 anchor (structure present but a significant organization defect) better than score 4's "minor organization gaps".

3 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states what the skill does, provides an explicit itemized "Use for:" trigger list, and carves out a distinct niche with minimal conflict risk. The only weakness is missing a few natural synonyms (e.g., "distributed training", "training job") that users might say.

DimensionReasoningScore

Specificity

The description itemizes many concrete actions — "writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration" — covering the full workload lifecycle. This matches the comprehensive anchor rather than the score-4 anchor, which allows "minor gaps in coverage"; no significant capability of the CLI is left unlisted.

5 / 5

Completeness

The "what" is explicit ("the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute") and the "when" is an explicit, itemized "Use for:" clause with concrete trigger phrases. Both are clearly and explicitly answered, matching the score-5 anchor; it exceeds score 4, where the "when" is present but "could be more explicit or specific".

5 / 5

Trigger Term Quality

Natural phrases users would say are present ("GPU training workloads", "hyperparameters", "run status", "logs", "Docker image"), giving good keyword coverage. It falls short of the score-5 anchor's "comprehensive coverage of natural terms including synonyms" because common user phrasings like "distributed training", "training job", or "MLflow" are absent, so a user asking about multi-node training setup might not trigger the skill.

4 / 5

Distinctiveness Conflict Risk

A clear niche is staked out — `databricks air` CLI commands for GPU training on Databricks serverless compute — with distinct triggers (workload YAML, air runs, serverless GPU workloads) that are unlikely to fire for other Databricks or general ML skills. This matches the "clear niche with distinct triggers; minimal conflict risk" anchor; it is above score 4's "minor overlap risk with closely related skills".

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 missing

Warning

Total

15

/

16

Passed

Repository

databricks/databricks-agent-skills

Path

plugins/databricks/codex/skills/databricks-ai-runtime/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.