Content
96%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary operational skill body: lean, assumes competence, gives copy-paste commands for every common case, and pairs them with explicit failure signatures and recovery actions. The only structural nit is that the dense verify-mode/OBO reference detail is inlined rather than split into a bundled reference file.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense operational knowledge with zero padding — no concept explanations Claude already has; instead it encodes non-obvious gotchas ("never pipe pytest through head/tail — SIGPIPE kills cleanup", "SSO storageState... expires ~daily", OBO scopes "must be CREATED... not patched later"). Every token carries repo-specific information; not score 4 because there is no over-explanation to trim, only inherent complexity. | 5 / 5 |
Actionability | Fully executable guidance: complete pytest invocations with env vars and flags (DATABRICKS_CONFIG_PROFILE=dogfood uv run --no-sync pytest validate_templates.py -p no:xdist -v), the auth_setup.py command with a URL template, repeatable --val-template usage, and a concrete config snippet (`<name>: { verify: html, expect: "Todo List App" }`). The `...` shorthand only abbreviates an already-shown full command, so everything is copy-paste ready. | 5 / 5 |
Workflow Clarity | Clear sequence (Prerequisites → Running → Interpreting results → Adding/fixing coverage) with explicit feedback loops: SSO failure ("app redirected to SSO login — storageState invalid/expired") → re-run auth_setup.py; 502 after ~240s → check build/runtime logs in the Apps UI; a checklist of expected non-pass buckets that are not template bugs. Not score 4 because validation checkpoints and error-recovery paths are explicit rather than minor-gap. | 5 / 5 |
Progressive Disclosure | Well-organized sections with one clearly signaled, one-level-deep pointer ("See .scripts/agent-integration-tests/AGENTS.md for module-level detail") and appropriate pointers to validation-config.yaml / functional_config.py for edits. Not score 5 because the long inline verify-mode semantics and OBO creation detail are borderline reference material that could live in a separate file, keeping SKILL.md a leaner overview. | 4 / 5 |
Total | 19 / 20 Passed |