Content
82%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A strong, highly actionable ops skill: executable commands with complete JSON specs, explicit dual-field readiness validation, common-failure callouts, and a well-managed one-level-deep reference for off-platform streaming. The main improvement opportunities are tightening small redundancies, moving the Apps-integration and MLflow-client detail into references, and adding a verification/caution step around the destructive delete command.
Suggestions
Trim the CLI Discovery section: the paragraph after the code block repeats the same 'run -h before constructing any command' instruction verbatim in spirit — keep one form.
Move the Apps integration walkthrough (manifest/init commands and databricks.yml/app.yaml snippets) into the databricks-apps skill or a local reference, keeping only the pointer in SKILL.md.
Add validation guidance for the destructive 'delete' operation in the Other Commands table (e.g., confirm the endpoint name via 'get' and check for dependent Apps/jobs before deleting).
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with Databricks-specific gotchas Claude would not know (entity-name derivation from 'served_entities[].name', 'state.ready' vs 'state.config_update', UIMessage-to-CoreMessage conversion in the reference) rather than generic explanations, fitting the score-4 anchor 'efficient; minor instances of over-explanation'. Not a 5 because of small redundancies: the CLI Discovery section restates the same '-h' instruction in both the code block and the immediately following paragraph, and the one-line background sentence 'Model Serving provides managed endpoints...' plus parts of the Apps integration YAML add tokens without new capability. | 4 / 5 |
Actionability | Fully executable, copy-paste-ready guidance throughout: complete 'create' JSON with traffic_config, query examples for both chat ('messages' array) and classical-ML ('dataframe_records') endpoints, a jq readiness-polling one-liner, a full runnable Python zero-downtime-swap script, the FM API runtime-discovery jq filter, and a troubleshooting table with exact commands. This matches the score-5 anchor 'specific examples cover the common cases'; the score-4 anchor's 'minor gaps' does not apply. | 5 / 5 |
Workflow Clarity | The core workflows have explicit validation checkpoints: readiness polling is elevated to 'Poll both' state.ready AND state.config_update with the mid-swap false-'ready' failure mode explained, and the version swap names the exact common bug (alias-only vs update-only). This fits the score-4 anchor 'clear sequence with most checkpoints present; minor validation gaps' — the gap being that 'delete <NAME>' appears in the command table with no caution or verification guidance (a destructive operation), and error-recovery loops live in the troubleshooting table rather than inline in the workflows, keeping it below the score-5 anchor's 'feedback loops for error recovery' embedded in the sequence itself. | 4 / 5 |
Progressive Disclosure | Good structure: the off-platform streaming material is correctly split into references/off-platform-streaming.md (verified to exist, one level deep, clearly signaled with a descriptive link and scope statement), headers make navigation easy, and cross-skill pointers (databricks-apps, databricks-ml-training, databricks-unity-gateway, parent databricks-core) are explicit. Falls short of the score-5 anchor because secondary material is still inlined in the body — the Apps integration section (~40 lines of scaffolding commands and YAML) and the MLflow Deployments client details sit in SKILL.md even though the body itself defers the full pattern to the databricks-apps skill, a 'minor organization gap' matching score 4. | 4 / 5 |
Total | 17 / 20 Passed |