CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment

Designs, sanity-checks and reads out product experiments (A/B tests, holdouts, pre/post, geo and incrementality tests) and produces an experiment brief plus a readout with a ship / hold / replicate call. Use when you ask 'should we A/B test this', 'how long should the test run', 'is this result real', 'sample size', 'stat sig', 'SRM', 'holdout', 'our win rate is low', or need to grade an existing test plan or readout. Draws on 191 insights from 71 Lenny's Podcast guests, led by Ronny Kohavi, Ramesh Johari and Archie Abrams.

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, well-structured decision system: routing table, numbered plays, decision rules, deliverable template, grading rubric, and red flags, with validation gates (trust checklist before reading lift) built into the workflow. It assumes Claude's competence throughout and pushes detail to two real reference files; the only structural improvement is moving inlined quote receipts into the existing quotes.md.

DimensionReasoningScore

Conciseness

Nearly every line carries a rule, a number, or a named benchmark ('about 8% of Microsoft experiments had SRM', 'fixed horizon of two weeks', '5% per quarter'); there is no padding explaining what A/B testing is, which Claude already knows. Minor instances could be trimmed — the dense per-guest attributions and the six inlined quote receipts — fitting 'efficient; minor instances of over-explanation that could be trimmed'.

4 / 5

Actionability

Fully executable guidance for an instruction-only skill: a copy-paste-ready deliverable template with fill-in blanks, a decision table mapping each result class to a default call, a 1/3/5 grading rubric with concrete anchors, and specific thresholds (200,000 users, 26% false-positive risk, 3/6/9/12-month re-reads). Concrete instruction covers the common cases end to end.

5 / 5

Workflow Clarity

The sequence is explicit (Diagnose with at most 4 questions → Pick the play via routing table → Run the selected play → deliverable → grade), with validation checkpoints as first-class steps: the Trust Checklist is explicitly run 'before anyone reads the lift', SRM failures are 'Invalid; fix and rerun', and SRM debugging steps name causes (bots, pipeline filters, side-campaign traffic). Red flags act as an error checklist.

5 / 5

Progressive Disclosure

The 'Go deeper' section cleanly signals two one-level-deep references that both exist and expand the body rather than duplicating it, and cross-links related skills. Minor gap: six verbatim quote receipts are inlined in the body while a separate references/quotes.md already holds the full verified quote set, so a little content that belongs in the bundle file is inline.

4 / 5

Total

18

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly covers what the skill does, when to use it, and the concrete deliverables it produces, with unusually rich natural trigger phrases including practitioner jargon. The only deductions are the second-person trigger phrasing (a voice penalty under this rubric) and minor overlap risk with adjacent validation skills.

DimensionReasoningScore

Specificity

The description lists multiple concrete, comprehensive actions ('Designs, sanity-checks and reads out product experiments (A/B tests, holdouts, pre/post, geo and incrementality tests) and produces an experiment brief plus a readout with a ship / hold / replicate call') with enumerations of test types and deliverables. This is a 5 on capability detail, reduced by 1 per the rubric's voice penalty because the trigger clause uses second person ('Use when you ask...') instead of third person.

4 / 5

Completeness

Clearly answers both what (designs/sanity-checks/reads out experiments; produces brief and readout with a ship/hold/replicate call) and when, with an explicit 'Use when...' clause listing concrete trigger phrases. This mirrors the anchor-5 example structure exactly.

5 / 5

Trigger Term Quality

Comprehensive coverage of natural phrases users would actually say: 'should we A/B test this', 'how long should the test run', 'is this result real', 'our win rate is low', plus jargon synonyms and abbreviations ('sample size', 'stat sig', 'SRM', 'holdout'). Matches the anchor-5 example's breadth including synonyms.

5 / 5

Distinctiveness Conflict Risk

The experimentation niche is clear with distinctive triggers (SRM, stat sig, holdout, sample size) unlikely to fire for unrelated skills. However, gate-type phrases like 'should we A/B test this' overlap with closely related validation/idea-testing skills, fitting 'mostly distinct; minor overlap risk' rather than the minimal-conflict anchor 5.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

menkesu/awesome-pm-skills

Path

skills/experiment/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.