Content
81%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-engineered skill body: a crisp contract, a sequenced nine-step workflow with explicit validation gates, and an executable statistical helper command. Main weaknesses are restated decision-ownership rules across four sections and a few compute paths that are named without example invocations. Progressive disclosure is solid, with both local reference files present and clearly signaled.
Suggestions
State the decision-ownership rule once authoritatively (e.g., in step 7) and reduce it to a one-line pointer in the intro, Skill Contract, and Next Best Skill sections to cut repeated tokens.
Add short example invocations for 'experiment.py continuous' and 'experiment.py samplesize' alongside the existing 'proportion' example so all compute paths are copy-paste ready.
Move the step 6 statistical-method menu into references/test-design-guide.md, keeping only the selection rule and a pointer inline.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is mostly lean and assumes competence (e.g., it names 'Two-proportion z-test' and 'Mann-Whitney U' without explaining them), but the decision-ownership rule is restated in the intro, Skill Contract, step 7, and Next Best Skill, which is trimmable repetition. It sits above the 'mostly efficient with some unnecessary explanation' anchor but short of 'every token earns its place'. | 4 / 5 |
Actionability | Concrete, executable guidance includes the copy-paste-ready helper invocation ('python3 "${CLAUDE_PLUGIN_ROOT}/scripts/connectors/experiment.py" proportion --control <conv> <n> ...'), a fill-in hypothesis template, and a specific data-source table. It falls short of the fully-executable anchor because the 'continuous' and 'samplesize' subcommands and the bootstrap/Mann-Whitney paths are named but never exemplified. | 4 / 5 |
Workflow Clarity | Nine numbered steps are clearly sequenced (mode → hypothesis → matrix → metrics → sizing → significance → decision ownership → provenance → binding verification) with explicit checkpoints: the NEEDS_INPUT gate in step 1, the precommitment decision gate in step 7, and the binding-refusal rule in step 9, plus a 'Done when' checklist. Error/recovery paths are explicit rather than implicit, matching the top anchor. | 5 / 5 |
Progressive Disclosure | Good structure with well-signaled, one-level-deep references — both referenced local bundle files (references/test-design-guide.md, references/measurement-control.md) exist — and a dedicated Reference Materials section. It falls short of the top anchor because some statistical detail in step 6 is inlined where the guide file would serve, and several references point outside the skill bundle to files that cannot be verified from it. | 4 / 5 |
Total | 17 / 20 Passed |