Content
68%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
Highly actionable content with strong executable commands and a well-validated submit workflow, undermined by a broken progressive-disclosure structure — the referenced docker-images.md is absent from the bundle — and by missing validation guidance for the destructive `cancel --all` operation. Inline, repeated version-sensitive details (CLI 1.20.0 format guidance, current accelerator types) also work against token efficiency.
Suggestions
Ship the missing docker-images.md file referenced in the 'Custom Docker images' section (and in the pre-flight step), or inline its essential guidance into SKILL.md — as written, both links dead-end.
Add a validation step before destructive batch cancels: for `databricks air cancel --all`, first run `databricks air list` to show active runs and confirm with the user before cancelling.
Consolidate the version-sensitive material (flattened vs nested `code_source` for CLI 1.20.0, and "Today's accelerator types") into a single compatibility/older-CLI section instead of repeating it across 'Session setup' and 'Workload YAML'.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Generally lean — dense tables, executable blocks, and no explanation of concepts Claude already knows — but the version-sensitive material is repeated inline: the CLI 1.20.0 flattened-vs-nested `code_source` guidance appears in both "Session setup" and "Workload YAML", and "Today's accelerator types are `GPU_1xA10` and `GPU_8xH100`" bakes time-sensitive values into the body. Per the rubric, inline version/date information not placed in a deprecated/compat section costs conciseness, so this is efficient-with-minor-trimming rather than fully lean. | 4 / 5 |
Actionability | Fully executable throughout: copy-paste commands ("databricks air run --file workload.yaml --dry-run -o json -p <profile>"), complete YAML blocks, a framework-to-`command:` launch table, a Python snippet for reading `$HYPERPARAMETERS_PATH`, and an error-`kind`-to-action table. The common cases (submit, monitor, sweep hyperparameters, wire secrets) are all covered with runnable examples. | 5 / 5 |
Workflow Clarity | "Starting a run" is a well-sequenced 5-step flow with an explicit validation checkpoint (step 4 dry-run: "A config-validation error is a hard stop") and a fix-and-resubmit loop, but the skill exposes the destructive batch operation "databricks air cancel ... --all" with no validation or confirmation guidance (e.g., list active runs and confirm with the user first). The rubric caps workflow clarity at 3 for destructive/batch operations lacking validation, which overrides the otherwise strong submit workflow. | 3 / 5 |
Progressive Disclosure | The body is well-sectioned, but it points to "[docker-images.md](docker-images.md)" twice ("Read [docker-images.md](docker-images.md) for step-by-step guidance") and that file does not exist anywhere in the bundle — the reference dead-ends, leaving the promised Docker guidance inaccessible. Additionally, the bundled assets (databricks.png, databricks.svg) are never referenced from the body. This is worse than 'references present but not clearly signaled' (3): the referenced content is simply missing, matching the minimal-structure anchor (2), though the body itself is navigable so not a 1. | 2 / 5 |
Total | 14 / 20 Passed |