Content
78%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured skill body: lean tabular guidance, a real and correctly documented bundled calculator, explicit launch/analysis checkpoints, and exemplary progressive disclosure into two reference files and a script. The only notable gaps are textbook statistics restatements and the absence of a concrete significance-testing command or error-recovery loop in the analysis phase.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is largely lean: tables, checklists, short bullets, and a copy-paste hypothesis template, with every section earning its place. Minor over-explanation of concepts Claude already knows keeps it below anchor 5 — e.g., '95% confidence = p-value < 0.05 / Means <5% chance result is random' and the 'Peeking Problem' paragraph restate textbook statistics. | 4 / 5 |
Actionability | Concrete, verified executable guidance: the bundled calculator is invoked with exact flags ('python3 scripts/sample_size_calculator.py --baseline 0.05 --mde 0.20 --json', '--daily-traffic') that match the script's actual argparse, plus a weak-vs-strong hypothesis example and specific metric tables. It falls short of anchor 5 only because the analysis section says 'Check confidence intervals' without a command or formula for actually computing significance. | 4 / 5 |
Workflow Clarity | The lifecycle is clearly sequenced (Initial Assessment → Hypothesis → Design → Sample Size → Pre-Launch Checklist → Running → Analysis → Documentation) with explicit checkpoints: the pre-launch checklist, 'Paste sample_size_per_variation... before any test is approved to run', the DO/DON'T list, and the 6-step analysis checklist. It misses anchor 5 because there is no error-recovery loop (e.g., what to do when QA or tracking verification fails) and the overall sequence is implied by section order rather than stated as one master workflow. | 4 / 5 |
Progressive Disclosure | The body acts as a clean overview with well-signaled, one-level-deep references that all exist in the bundle: 'See [references/sample-size-guide.md](references/sample-size-guide.md)' for detailed tables, 'See [references/test-templates.md](references/test-templates.md)' for templates, and the bulk calculation logic delegated to scripts/sample_size_calculator.py. Content is appropriately split — only the small quick-reference table and usage examples stay inline — matching the anchor-5 example structure. | 5 / 5 |
Total | 17 / 20 Passed |