CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment-designer

Use when planning product experiments, writing testable hypotheses, estimating sample size, prioritizing tests, or interpreting A/B outcomes with practical statistical rigor.

61

Quality

77%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./product-team/skills/experiment-designer/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, largely actionable skill body with a clear six-step workflow, a real verified script, and proper one-level-deep references. The main costs are token inefficiency from re-teaching basic statistics inline and duplicating the calculator example, plus bare unannotated reference pointers.

Suggestions

Move the 'Statistical Interpretation Guardrails' bullets into `references/statistics-reference.md` (they re-teach p-value and CI basics Claude already knows and duplicate that file's content).

Keep a single sample-size calculator example: the Tooling section repeats the command already shown in workflow step 3 — merge them into one usage block with flags.

Annotate the reference links with what each covers, e.g. 'experiment types and metric design: `references/experiment-playbook.md`; p-values, CIs, and MDE: `references/statistics-reference.md`'.

DimensionReasoningScore

Conciseness

The workflow itself is lean, but three spots pad the token budget: the 'Statistical Interpretation Guardrails' section re-teaches basics Claude already knows ("p-value < alpha indicates evidence against null", "Wide intervals imply low precision even when significant"), the Tooling section repeats the sample-size command already shown in step 3, and 'When To Use' restates the frontmatter description. This matches 'mostly efficient but includes some unnecessary explanation or could be tightened' rather than the minor-trim 4 anchor.

3 / 5

Actionability

Concrete, executable guidance throughout: an If/Then/Because hypothesis template with placeholder slots, metric-role definitions, the ICE formula, and a copy-paste-ready command (`python3 scripts/sample_size_calculator.py --baseline-rate 0.12 --mde 0.02 --mde-type absolute`) whose flags match the actual script. It stops short of 5 because there is no worked example (a filled-in hypothesis or numeric ICE calculation) and no sample calculator output to interpret.

4 / 5

Workflow Clarity

The six-step sequence (hypothesis, metrics, sample size, prioritize, launch, interpret) is clearly ordered, with an explicit Hypothesis Quality Checklist as a checkpoint and pre-registered stopping rules ("Decide fixed sample size or fixed duration in advance"), matching the 'clear sequence with most checkpoints present; minor validation gaps' anchor. It is not 5 because there is no explicit validate-and-iterate feedback loop after launch or when guardrails trip.

4 / 5

Progressive Disclosure

Clear sections with both referenced files (`references/experiment-playbook.md`, `references/statistics-reference.md`) verified to exist exactly one level deep, plus a documented script. Minor gaps keep it at 4: the 'See:' list is bare with no annotation of what each file covers, and the inline Statistical Interpretation Guardrails duplicate content that belongs in `references/statistics-reference.md`.

4 / 5

Total

15

/

20

Passed

Description

75%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong trigger-focused description with explicit 'Use when' guidance and natural keywords covering the full experiment lifecycle. Its main weakness is that the 'what' — the concrete deliverables the skill produces — is only implicit in the trigger list, and a few common synonyms are missing.

Suggestions

Add an explicit capability statement before the trigger clause, e.g. 'Designs, prioritizes, and evaluates product experiments with testable hypotheses and pre-computed sample sizes.'

Include common synonyms such as 'A/B tests', 'split tests', or 'experiment results' in the trigger list to catch more natural phrasings.

Replace the soft phrase 'with practical statistical rigor' with a concrete deliverable (e.g. 'with power-based sample size calculations and guardrail metrics').

DimensionReasoningScore

Specificity

The description lists several concrete actions — "planning product experiments, writing testable hypotheses, estimating sample size, prioritizing tests, or interpreting A/B outcomes" — covering the experimentation lifecycle, matching the 'several specific actions; minor gaps' anchor. It falls short of 5 because the actions appear only inside the 'when' clause rather than as explicit capability statements, and "with practical statistical rigor" is soft padding.

4 / 5

Completeness

The 'when' is explicit and specific ("Use when planning product experiments, ... or interpreting A/B outcomes"), and the 'what' is only implicitly conveyed through the gerund action list rather than a standalone capability statement. This sits between the 3 anchor (what present, when missing) and the 5 anchor (both explicitly stated), matching anchor 4's 'both present but one could be more explicit'.

4 / 5

Trigger Term Quality

Natural trigger phrases like "product experiments", "testable hypotheses", "sample size", and "A/B outcomes" match how users would phrase these needs, fitting the 'good keyword coverage; a few natural terms missing' anchor. It is not 5 because common synonyms such as "split test", "significance", "power", or "conversion rate" are absent.

4 / 5

Distinctiveness Conflict Risk

The experimentation/statistics niche is clear and mostly distinct, but "prioritizing tests" could collide with software test-prioritization requests and "practical statistical rigor" overlaps generic data-analysis skills, fitting the 'mostly distinct; minor overlap risk' anchor rather than the fully distinct 5 anchor.

4 / 5

Total

16

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

alirezarezvani/claude-skills

Path

product-team/skills/experiment-designer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.