Content
100%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary skill body: fully executable commands at every step, tightly written with no concept explanations, explicit validation gates and feedback loops at each risky point, and a clean split between the manual and the tool/pack files it drives. The only unverifiable aspect is the existence of the referenced bundle files, which is a limitation of the provided extraction rather than a visible defect.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is purely operational — commands, flags, JSON field names, and a failure taxonomy — with zero explanation of concepts Claude already knows ("A pass rate alone is not a finding"). The densest passages (pack task enumerations, the full/lean split) are decision-relevant facts rather than padding, so every token earns its place. | 5 / 5 |
Actionability | Every stage has a copy-paste-ready command with exact flags ("probe --base-url <url> --model <id> --out <run_dir>", "run ... --quick --samples 1"), and all placeholders are defined in earlier steps. Failure reading names exact fields ("smoke.ok", "loaded[].context_length", "finish_reason", "reason"), and common cases like quantization comparison get exact commands (--label into the same run directory). | 5 / 5 |
Workflow Clarity | Eight numbered stages from discovery to handoff with an explicit validation gate ("`smoke.ok` must be true. If not, report the error; do not continue"), progress monitoring (terminal sessions, the "DONE" log line), an error-diagnosis loop (section 6's named causes), and a targeted-experiment feedback loop (section 7). Risky points also carry safety checkpoints, such as reading a vendor pack's unit tests before model-written code executes locally. | 5 / 5 |
Progressive Disclosure | SKILL.md is a lean operating manual whose implementation and data are appropriately split into one-level-deep, clearly signaled files ("holaeval.py in this skill's directory", "packs/general-v1.json", "packs/agent-v1.json"), with nothing reference-sized inlined and trivial navigation via numbered sections. Note: the referenced tool/pack files are not present in this review bundle so their existence could not be verified, but the structure and signaling are exemplary. | 5 / 5 |
Total | 20 / 20 Passed |