Content
67%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured, largely actionable skill body with a clear six-step workflow, a real verified script, and proper one-level-deep references. The main costs are token inefficiency from re-teaching basic statistics inline and duplicating the calculator example, plus bare unannotated reference pointers.
Suggestions
Move the 'Statistical Interpretation Guardrails' bullets into `references/statistics-reference.md` (they re-teach p-value and CI basics Claude already knows and duplicate that file's content).
Keep a single sample-size calculator example: the Tooling section repeats the command already shown in workflow step 3 — merge them into one usage block with flags.
Annotate the reference links with what each covers, e.g. 'experiment types and metric design: `references/experiment-playbook.md`; p-values, CIs, and MDE: `references/statistics-reference.md`'.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The workflow itself is lean, but three spots pad the token budget: the 'Statistical Interpretation Guardrails' section re-teaches basics Claude already knows ("p-value < alpha indicates evidence against null", "Wide intervals imply low precision even when significant"), the Tooling section repeats the sample-size command already shown in step 3, and 'When To Use' restates the frontmatter description. This matches 'mostly efficient but includes some unnecessary explanation or could be tightened' rather than the minor-trim 4 anchor. | 3 / 5 |
Actionability | Concrete, executable guidance throughout: an If/Then/Because hypothesis template with placeholder slots, metric-role definitions, the ICE formula, and a copy-paste-ready command (`python3 scripts/sample_size_calculator.py --baseline-rate 0.12 --mde 0.02 --mde-type absolute`) whose flags match the actual script. It stops short of 5 because there is no worked example (a filled-in hypothesis or numeric ICE calculation) and no sample calculator output to interpret. | 4 / 5 |
Workflow Clarity | The six-step sequence (hypothesis, metrics, sample size, prioritize, launch, interpret) is clearly ordered, with an explicit Hypothesis Quality Checklist as a checkpoint and pre-registered stopping rules ("Decide fixed sample size or fixed duration in advance"), matching the 'clear sequence with most checkpoints present; minor validation gaps' anchor. It is not 5 because there is no explicit validate-and-iterate feedback loop after launch or when guardrails trip. | 4 / 5 |
Progressive Disclosure | Clear sections with both referenced files (`references/experiment-playbook.md`, `references/statistics-reference.md`) verified to exist exactly one level deep, plus a documented script. Minor gaps keep it at 4: the 'See:' list is bare with no annotation of what each file covers, and the inline Statistical Interpretation Guardrails duplicate content that belongs in `references/statistics-reference.md`. | 4 / 5 |
Total | 15 / 20 Passed |