CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ab-testing

When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program.

59

Quality

74%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/ab-testing/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, genuinely actionable skill body with real reference files and strong checklists throughout. The main costs are redundant explanations of statistics concepts Claude already knows and a large inline growth-program section that belongs in the references directory.

Suggestions

Cut the 'Statistical Significance' explanation and 'The Peeking Problem' prose down to one-line reminders — Claude already knows what p-values and peeking are; only the skill's rule ('pre-commit to sample size, don't stop early') needs stating.

Move the Growth Experimentation Program section (playbook template, velocity targets, cadences) into a references/ file like the sample-size and template content, keeping only the experiment loop and ICE summary inline.

Add one concrete tool-specific example (e.g., a PostHog experiment-setup step or flag definition) so the implementation section's guidance matches the specificity of the design and analysis sections.

DimensionReasoningScore

Conciseness

The body is mostly efficient tables, checklists, and templates, but sections like 'Statistical Significance' ('95% confidence = p-value < 0.05; Means <5% chance result is random'), 'The Peeking Problem' prose, and 'Test One Thing — Otherwise you don't know what worked' re-explain concepts Claude already knows. These unnecessary explanation blocks go beyond the 'minor instances' of anchor 4, while the bulk remains dense and useful (not anchor 2's heavy padding).

3 / 5

Actionability

Concrete, usable artifacts dominate: a fill-in hypothesis template, real sample-size quick-reference tables with numbers, calculator links, pre-launch and analysis checklists, and a copy-paste playbook template. Some guidance stays high-level ('Check confidence intervals'; tool names like PostHog and LaunchDarkly with no setup steps), so it falls short of anchor 5's fully-executable coverage.

4 / 5

Workflow Clarity

The section order lays out a clear sequence (assess → hypothesize → design → implement → run → analyze → document) reinforced by explicit checkpoints: a pre-launch checklist, during-test DO/avoid lists, and a 6-step analysis checklist. There are no explicit error-recovery loops (validate → fix → retry), so it does not reach anchor 5; checkpoints are far more present than anchor 3's 'implicit' level.

4 / 5

Progressive Disclosure

Both inline references (references/sample-size-guide.md and references/test-templates.md) exist as real bundle files, are clearly signaled, and are one level deep with appropriate content splits. The ~80-line Growth Experimentation Program section (playbook template, velocity tables) is substantial inline detail that could live in a reference, keeping it below anchor 5.

4 / 5

Total

15

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A solid description with an explicit trigger clause and natural domain keywords, though the capability statement is generic and folded into the when-clause. It would benefit from a distinct what-statement and broader synonym coverage.

Suggestions

Add a standalone what-statement listing concrete capabilities, e.g., 'Guides A/B test design: hypothesis framing, sample-size calculation, variant design, and statistical analysis. Use when...' — this would also lift specificity.

Include the common synonym 'split test' (and optionally 'multivariate test') in the trigger terms, since users frequently say 'split test' rather than 'A/B test'.

DimensionReasoningScore

Specificity

The description names the domain ('A/B test or experiment', 'growth experimentation program') with actions 'plan, design, or implement', but those verbs form one generic cluster and skip concrete capabilities like sample-size calculation or variant design. It exceeds a domain-only label (not 2) but does not list several distinct, specific actions (not 4).

3 / 5

Completeness

An explicit trigger clause is present ('When the user wants to...') and the what is embedded in it, so the missing-trigger cap of 3 does not apply. However, there is no standalone statement of the skill's own capabilities — the 'what' is expressed only through the user's desire — so it does not clearly and explicitly answer both what and when as anchor 5 requires.

4 / 5

Trigger Term Quality

'A/B test', 'experiment', and 'growth experimentation program' are natural phrases users would say when needing this skill. Coverage is good but misses common synonyms like 'split test' and 'multivariate', so it falls short of the comprehensive anchor 5.

4 / 5

Distinctiveness Conflict Risk

'A/B test' and 'growth experimentation program' define a clear niche with minimal conflict risk. The word 'experiment' is somewhat broad and overlaps with sibling skills it names (cro, analytics), keeping it just below anchor 5's 'minimal conflict risk'.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

administrakt0r/AI-Agents-Safe-Coding-Skills

Path

skills/ab-testing/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.