Content
78%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A strong, opinionated instruction skill: concrete thresholds, worked examples, and decision rules make it highly actionable, and the bundle structure (verified principles-in-body, details-in-files, one-level references) is exemplary. The main weakness is conciseness — textbook statistical explanations Claude already knows and motivational asides inflate the body without adding guidance.
Suggestions
Cut the textbook statistical explanations (the definition of power, the one-sided vs two-sided tutorial, the peeking false-positive math, and the SPRT/mSPRT method taxonomy) down to the one-line decision rules they justify — Claude already knows this math; keep only the PM-facing rules like 'default to two-sided' and 'pre-commit if the platform lacks sequential testing'.
Trim the rhetorical passages — the 'default state of experimentation is sloppy' intro, the 'Worth being direct about' aside, and the motivational closing about 'saying I do not know out loud' — reducing the closing to its actionable rule (default to not shipping when results are unclear).
Inline the ten-item go/no-go readiness checklist (or at least its gate conditions) into the body so the pre-launch validation checkpoint is part of the stated workflow rather than only reachable via a reference.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Mostly efficient, but it explains statistics Claude already knows — "Power. The test's ability to detect an effect that is actually present," the one-sided vs two-sided tutorial, "The math. With one analysis, false positive rate is 5 percent," and an enumeration of SPRT/mSPRT methods — plus rhetorical padding ("The default state of experimentation in most companies is sloppy," "Worth being direct about," the motivational closing "the discipline of saying 'I do not know' out loud"). Not 4: these are more than minor instances (full definitional paragraphs, not one-line trimmables); not 2: the majority of every section delivers skill-specific decision rules rather than generic concept explanation, so it is not 'noticeably verbose' overall. | 3 / 5 |
Actionability | Concrete, immediately applicable decision rules throughout: "Pick exactly one primary metric. Pick three to five guardrails," "if your minimum detectable effect (MDE) ... is greater than 5 percent absolute lift, you probably need a bigger MDE," "Two weeks is the conventional minimum for any UI/UX experiment," "Usually four to six weeks," a fully worked good-vs-bad hypothesis pair, a literal vendor question ("What is your variance estimator for ratio metrics?"), the p-hacking inventory, and the pre-commitment list. Per the scoring notes for instruction-only skills, absence of code is not penalized; specific examples cover the common cases. | 5 / 5 |
Workflow Clarity | The 12-consideration framework plus lifecycle-ordered sections (hypothesis, sizing, duration, running discipline, interpretation, decision) give a clear sequence, with checkpoints in pre-commitment, the three-bucket decision, holdout monitoring, and the go/no-go readiness checklist. Not 5: the go/no-go and moment-of-decision checklists live in reference files rather than inline, and there is no single consolidated step order with feedback loops (e.g., what to redo when the readiness check fails); not 3: checkpoints are explicit and the sequence is coherent, not merely implicit. | 4 / 5 |
Progressive Disclosure | The body is a well-organized overview of principles, with all seven referenced files verified to exist and to be exactly one level deep (each points only back to SKILL.md, no nested chains). Every reference is linked in its relevant section (e.g., "expanded in [`references/common-failures.md`]") and consolidated in a "Reference files" section with one-line descriptions. Content is appropriately split: templates, tables, checklists, and platform profiles live in files; principles live in the body. Matches the clear-overview anchor. | 5 / 5 |
Total | 17 / 20 Passed |