CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ab-testing

When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics. For page-level conversion optimization, see cro.

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered body: lifecycle-sequenced with explicit checklists at launch and analysis, copy-paste templates, real numeric guidance, and correctly linked one-level-deep references for the bulky material. The two residual costs are the statistics tutorial paragraph that re-teaches known concepts and the inline growth-program section that would fit the bundle's progressive-disclosure pattern as its own reference file.

Suggestions

Trim the 'Statistical Significance' paragraph to the practice rules (use the planned analysis and stopping rule; report interval and effect size) and drop the textbook definitions of p-values and confidence intervals — keep only the ASA link for users who want the background.

Move the Growth Experimentation Program section (experiment loop, ICE, velocity, playbook cadence) into a references/growth-program.md file and signal it from the body the way sample-size-guide.md and test-templates.md are, keeping SKILL.md focused on the single-test workflow.

DimensionReasoningScore

Conciseness

The body is token-efficient by construction — dense tables, checklists, and bullet fragments with almost no filler. The exception is the p-value/confidence-interval tutorial paragraph in 'Statistical Significance,' which explains statistical definitions Claude already knows and could be trimmed to just the practice guidance. Anchor 4, not 5, because of that over-explained stretch.

4 / 5

Actionability

Fully concrete for an instruction-only skill: a copy-paste hypothesis template with weak/strong examples, a numeric sample-size quick-reference table (e.g., '3% baseline, 20% lift → 12k/variant'), the ICE formula, named tools per implementation style, and a fill-in playbook template with exact fields. Common cases are covered with specifics; absence of code is not penalized per the rubric's instruction-skill note.

5 / 5

Workflow Clarity

The sections follow the test lifecycle (assess → hypothesize → design → size → run → analyze → document) and the Experiment Loop is explicitly numbered 1–6. Validation is explicit: a 6-item pre-launch checklist ('Tracking verified,' 'QA completed on all variants'), during-test monitoring with DO/Avoid, and a 6-item analysis checklist with error-recovery guidance (mixed signals → check data quality, confirm segments in a new test; stop if guardrails go significantly negative). Not a destructive/batch skill, so no cap applies.

5 / 5

Progressive Disclosure

Both references exist, are one level deep, and are purpose-signaled ('For detailed sample size tables and duration calculations: See references/sample-size-guide.md'; 'For templates: See references/test-templates.md'), with quick tables inline and the bulk split out. Falls short of anchor 5 because the ~85-line Growth Experimentation Program section is a self-contained unit that could live in its own reference file, leaving the main body longer than a lean overview.

4 / 5

Total

18

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit what-and-when structure, an unusually rich set of natural trigger phrases, and routing guidance that delineates it from adjacent analytics/CRO skills. The only weaknesses are the omission of test analysis from the stated capabilities and a few over-broad trigger terms that risk false positives.

DimensionReasoningScore

Specificity

Concrete actions are named — 'plan, design, or implement an A/B test or experiment' and 'build a growth experimentation program' — giving several specific capabilities. Not a 5 because the analysis/interpretation work the skill clearly supports is absent from the action list; not a 3 because more than 1-2 actions are covered.

4 / 5

Completeness

Explicitly answers both what ('plan, design, or implement an A/B test or experiment, or build a growth experimentation program') and when ('Also use when the user mentions…', 'Use this whenever someone is comparing two approaches…') with concrete trigger phrases, and adds disambiguation routing ('For tracking implementation, see analytics. For page-level conversion optimization, see cro.').

5 / 5

Trigger Term Quality

Eighteen-plus natural quoted phrases users would actually say ('A/B test,' 'split test,' 'should I test this,' 'which version is better,' 'test two versions,' 'how long should I run this test,' 'ICE score,' 'experiment playbook') plus synonyms, program-level terms, and scenario framings ('comparing two approaches and wants to measure which performs better'). Comprehensive coverage matches the top anchor.

5 / 5

Distinctiveness Conflict Risk

Clear experimentation niche with explicit routing to sibling skills, but the very broad quoted terms 'experiment,' 'hypothesis,' and 'test this change' could over-trigger in non-growth contexts (e.g., testing a code change). Minor overlap risk with closely related skills — anchor 4, not 5.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

coreyhaines31/marketingskills

Path

skills/ab-testing/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.