Content
70%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is highly actionable with excellent workflow sequencing and validation, but it is noticeably verbose and monolithic. Inline version-changelog markers and anecdotal rationale padding hurt token efficiency, and the lack of any bundle/reference files means a long wall of inlined detail rather than a lean overview pointing to deeper materials.
Suggestions
Move the inline version annotations (v0.6–v1.14) and bug-discovery anecdotes into a CHANGELOG or 'design notes' reference file so the active instructions stay lean; the rubric penalizes version numbers not placed in a deprecated/old-patterns section.
Split the long per-subcommand detail (grader-audit branch logic, experiment preset designs, check-in branches) into one-level-deep reference files (e.g. GRADER-AUDIT.md, EXPERIMENTS.md) and keep SKILL.md as a concise overview with clearly signaled links, raising progressive disclosure.
Trim narrative rationale and illustrative quote anecdotes to the minimum needed for the decision rule, retaining the executable commands and branch conditions but cutting the backstory prose.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is noticeably verbose: pervasive inline version markers (v0.6, v0.7, v0.8, v1.3, v1.4, v1.9, v1.14, etc.) appear throughout the active instructions rather than in a deprecated section, and several padded anecdote/bug-history sections ('Found by a dogfood', 'v0.8.0 led with... a learner who had failed five capabilities') could be trimmed. It is not a 1 because it avoids explaining basic concepts Claude already knows and the core guidance is actionable. | 2 / 5 |
Actionability | The body is fully executable: copy-paste-ready bash blocks resolve the engine, then run concrete commands with exact flags (e.g. 'python3 "$ENGRAM" gold > /tmp/engram-gold.json', 'experiment start --json ...', 'assessor-audit --file ... --canary --grader-context ...') covering every subcommand. | 5 / 5 |
Workflow Clarity | Multi-step workflows are clearly sequenced with explicit validation and feedback loops — the audit's three independent spawns with fail-closed 'assessor-audit dies if answers leak', the 'Four steps, and none may be skipped' contribute flow that degrades to silence, and the experiment pre-register/assign/settle pipeline with powered-check gating. | 5 / 5 |
Progressive Disclosure | Section headers are clear and well-organized by subcommand, and external doc references are signaled inline ('docs/08 §2', 'docs/05 P14', CONTRIBUTING-DATA.md), but the file is a ~350-line monolith with detailed branch logic, experiment presets, and rationale inlined that clearly belongs in separate reference files. The simple-skill exception does not apply given the length and external references. | 3 / 5 |
Total | 15 / 20 Passed |