Content
93%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary diagnostic skill body: dense with platform-specific facts Claude cannot know, copy-paste-ready commands and exact log signatures, and clean section structure. The only gap is the absence of an explicit recovery/verification loop for the failure paths of the diagnostic procedure itself (empty log viewer, watchdog toggle not taking effect).
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Every token carries non-obvious, platform-specific information (SSO websocket 302 blocking the CLI, SIGTERM all-thread dumps, pods lacking CAP_SYS_PTRACE) with no padding and no explanation of concepts Claude already knows. Even the 'Why not pyspy/gdb/strace' note conveys real constraints rather than filler. | 5 / 5 |
Actionability | Fully executable throughout: the log-viewer URL pattern, 'databricks apps logs <app-name> --follow --profile <profile>', 'databricks apps get ... | jq '.app_status'', a concrete app.yaml env snippet, 'kill -USR1 <pid>', and exact log signatures to match — covering the common Python, Node, crash, and hang cases. | 5 / 5 |
Workflow Clarity | The diagnostic sequence is clear (read logs → match signatures → hang-specific escalation) with a built-in checkpoint ('app.diagnostics: installed (pid=…)' confirms the bootstrap ran) and explicit SSO/non-SSO branching. It falls short of anchor 5 only because there is no explicit error-recovery loop, e.g. what to do when the log viewer shows nothing or how to confirm the watchdog toggle took effect after redeploy. | 4 / 5 |
Progressive Disclosure | Well-organized sections with no content that belongs in a separate file at this size, and the single external pointer (crash fixtures at '.scripts/agent-integration-tests/crash-examples/') is clearly signaled and exactly one level deep. Navigation is easy and there are no nested references. | 5 / 5 |
Total | 19 / 20 Passed |