Content
100%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body exemplifies judgement-skill guidance: every section either names exact files, commands, and output shapes, or gives a prioritized checklist with concrete failure examples. Sequences are explicit with validation built in (gate-first policy, adapter rejection, evidence sampling), and the self-contained structure with no dead references is appropriately sized for a single file. No dimension shows a gap against the top anchors.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and imperative throughout — 'Never spend judgement on what that gate decides: run it first and read its findings', 'Never report the with-arm score alone' — with no explanation of concepts Claude already knows; the only background given (what the deterministic gate covers, what an eval run stages) is repo-specific knowledge Claude would not have. It is not 4 because no section can be trimmed without losing a directive or a concrete failure example. | 5 / 5 |
Actionability | Guidance is concrete and executable: exact files to read ('task.md, criteria.json, inputs/setup.sh'), exact commands ('gh pr diff <number>', 'bin/evalctl check --changes origin/main', 'bin/evalctl grade --suite <dir> --judge-cmd ...'), and an exact output shape ('[{"name", "score", "max", "note"}]'). Each judgement question includes concrete failure instances ('a clean working tree when the task asks for an untracked artifact'), meeting anchor 5 for an instruction-only skill with copy-paste-ready commands covering the common cases. | 5 / 5 |
Workflow Clarity | Multi-step processes are explicitly sequenced: scoping options by input type, 'Then ask, in this order' for the six scenario questions, a numbered 4-step grading procedure, and ranked reporting. Validation checkpoints are present — the adapter 'rejects a judgement that does not cover exactly the pending criteria' with a --resume recovery loop, and 'still read a sample of the evidence' guards the totals. Not 4 because both the sequence and the validation/recovery loops are explicit, not implicit. | 5 / 5 |
Progressive Disclosure | No bundle files exist (no references/, scripts/, or assets/), and none are needed: the body is a compact ~100-line judgement guide split into seven clearly headed sections with no buried references and no content that belongs in a separate file. Navigation is trivial via the section headers; nothing is inlined that should be split out, so it matches the well-organized, self-contained top anchor rather than anchor 4's 'minor organization gaps'. | 5 / 5 |
Total | 20 / 20 Passed |