Content
88%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-engineered operational skill: seven gated steps, an executable SRM script with worked numbers and an exit-code contract, sign-off separation of duties, and a real one-level reference template. Remaining polish is trimming two or three lines of explanation Claude already knows and moving the SRM taxonomy or guardrail/peeking detail into bundle references.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and table-driven with essentially no padding, but contains minor trimmable over-explanation Claude does not need, e.g. "An SRM means the observed split differs from the configured one" and "`scipy.stats.chisquare` takes observed and expected counts and returns the statistic and p-value", fitting anchor 4 rather than 5's every-token-earns-its-place profile. | 4 / 5 |
Actionability | The srm_check.py script is complete and executable with a usage line, exit-code contract, and worked example ("For 503,000 / 497,000 at 50/50: chi2 = 36.0, p ≈ 2e-9"), and every step names concrete file paths (experiments/<id>/proposal.yml, checklist.md, result.md), matching the copy-paste-ready top anchor. | 5 / 5 |
Workflow Clarity | Steps 1-7 are sequenced gates with explicit checkpoints (Step 1 and Step 4 "Checkpoint:" blocks), a validate-fix-rerun feedback loop for SRM ("Fix the cause, then either restart the experiment or exclude the affected period, re-run `srm_check.py`, and continue only on exit code 0"), and a hard decision rule ("Any failed gate means 'no-ship' or 'extend', never 'ship with a note'"), matching the top anchor; the skill is not destructive/batch so no cap applies. | 5 / 5 |
Progressive Disclosure | The single reference (references/checklist-template.md, verified to exist) is one level deep and clearly signaled from both Overview and References, and sections are well organized, but details such as the SRM root-cause taxonomy and the guardrail/peeking methodology are inlined or deferred by sibling-skill name rather than bundle paths, fitting anchor 4's minor-organization-gaps profile rather than 5. | 4 / 5 |
Total | 18 / 20 Passed |