Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A high-quality ops skill body: executable commands with complete JSON specs throughout, explicit readiness validation with a documented failure mode, conditional workflows, and an appropriately split single reference file. The only weakness is minor token redundancy (restated discovery instructions and a redundant structure diagram) that keeps it just short of maximally lean.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with Databricks-specific knowledge Claude cannot know (traffic_config route naming, dual state polling, tags-as-top-level-kwarg, the Serving UI 'Owned by me' filter gotcha) and assumes CLI/JSON competence. It falls short of 5 due to minor trimmable redundancy: the CLI-discovery instruction is stated twice ('Run databricks serving-endpoints -h before constructing any command. Run databricks serving-endpoints <subcommand> -h...' immediately restates the preceding code block), and the ASCII endpoint-structure tree restates facts already covered in the bullets below it. | 4 / 5 |
Actionability | Every section is copy-paste ready: a complete `create` command with full JSON spec, executable `query` examples for both chat and classical-ML payloads, a jq readiness-extraction pipeline, a complete Python zero-downtime-swap script, a jq filter for runtime FM API discovery, and a troubleshooting table keyed to exact error strings and commands. This matches the 5 anchor ('fully executable; covers the common cases'), not 4, since even the gotchas come with concrete remediation commands. | 5 / 5 |
Workflow Clarity | Multi-step processes are explicitly sequenced with validation checkpoints: create → poll with the dual check 'Fully ready when ready == "READY" AND config_update == "NOT_UPDATING"' (including the trap of polling only state.ready mid version-swap); the swap workflow spells out that omitting either the alias repoint or update_endpoint 'is the common bug'; the App integration flow is a conditional Step 1 / Step 2. The Troubleshooting table supplies feedback loops (error → diagnose → fix), matching the 5 anchor. The destructive-cap guidance does not apply: delete appears only as a one-line table row, not as an unvalidated destructive workflow. | 5 / 5 |
Progressive Disclosure | Against the actual bundle: the single reference file (references/off-platform-streaming.md, 182 lines) is real, clearly signaled with a descriptive link ('For apps deployed outside Databricks Apps (Vercel, AWS, standalone Node.js)... see [references/off-platform-streaming.md]'), one level deep, and correctly split out of the core ops body. Cross-skill pointers (databricks-apps model-serving guide, databricks-ml-training, databricks-unity-gateway) are all explicitly named with rationale. The body's well-headed sections plus this clean split match the 5 anchor, not 4, since there is no inline content that clearly belongs in a separate file. | 5 / 5 |
Total | 19 / 20 Passed |