Content
88%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An unusually strong body: everything is project-specific, executable, and validated, with explicit feedback loops for a genuinely complex batch workflow. The only real gaps are trimmable over-detail in the run/isolation internals and a monolithic length that leaves little for reference files to carry.
Suggestions
Trim the internals that describe behavior the library already enforces (e.g. the ledger/watermark clearing details in 'Running' and several Gotchas) down to the operator-facing rule, keeping the body to what an author needs to decide.
Move the worked module template, the full description/bronze format spec, and the date-window test design into a references/ file (linked one level deep from the body) so SKILL.md stays a scannable overview plus the scaffold/validate/run loops.
Sharpen the description's final trigger phrase ("or check a spec") to something niche-bound like "check a metric spec" to eliminate overlap with other testing skills.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and assumes competence — no basic-concept padding, every section teaches repo-specific machinery ("silver reads staging through the union_by_tag macro", "MIN_PEER_N in domain/metric_results/compiler.rs"). A few sections run longer than needed for a working author (the per-module isolation/clearing internals and several gotchas spell out behavior the library already enforces), fitting anchor 4 ("minor instances of over-explanation that could be trimmed") rather than 5. | 4 / 5 |
Actionability | Fully executable, copy-paste-ready guidance: complete runnable commands ("uv run --project tests --frozen --group datapath --no-group dev python -c …", "./dev-compose.sh test-stand test --tree=tests/datapath/metrics/<class> --instance=datapath -q") and full worked templates (the module example, the bronze/description YAML shapes, the identity_aliases block) cover the common cases. Matches anchor 5 exactly; not a 4 because the templates are complete rather than having gaps. | 5 / 5 |
Workflow Clarity | "Scaffolding a new test" is a numbered 1–6 sequence, "Validating a test (no stand needed)" gives explicit validation commands, and "Gotchas" supplies error-recovery feedback ("Let the run finish, then re-run"; "Lint before or after, never during"). Validation checkpoints are explicit, so the batch/destructive cap does not apply — this is the anchor-5 pattern (checklist + explicit validation + recovery loops). | 5 / 5 |
Progressive Disclosure | No bundle files exist, and the body is a well-sectioned single file whose outward references are one level deep and clearly signaled ("Source of truth (reference — open only if you need the detail)" → tests/lib/insight_datapath/ and worked example specs). At ~450 lines, though, content that could live in reference files — the full format spec, the date-window design section, the complete module template — is inlined, which fits anchor 4 ("good structure; minor organization gaps") better than 5. | 4 / 5 |
Total | 18 / 20 Passed |