CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ab-test-designer

Design robust A/B test experiments. Use when testing a new feature, validating a hypothesis, or optimizing conversion rates.

Quality

72%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.agents/skills/ab-test-designer/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

53%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body has a solid skeleton — a clear five-part test design checklist and genuinely useful best practices — but it is undermined by boilerplate filler, a prompt-template framing instead of direct instructions, and an example truncated mid-sentence. It reads as a generic template with the domain-specific substance only partially filled in.

Suggestions

Complete or remove the truncated Example section, which currently ends mid-sentence at "Hypothesis (new 1-step flow will increase co...".

Cut the "Domain Context", "Input Requirements", and duplicated "When to Use" sections, which restate the frontmatter and add no actionable guidance.

Add the concrete statistical details the checklist promises: a sample-size method (e.g. baseline rate, minimum detectable effect, alpha/power defaults) and a recommended significance threshold for the Analysis Plan.

DimensionReasoningScore

Conciseness

The core checklist and "Best Practices" are tight, but the body pads tokens with non-actionable boilerplate: "This skill implements a proven product management framework. The approach combines best practices from industry leaders", a generic "Input Requirements" section, and a "When to Use" list that duplicates the frontmatter description verbatim. This is noticeably more padding than the minor-trim level of 4, but the bulk of the body is still efficient, so it is not 2.

3 / 5

Actionability

The numbered 1-5 output structure (Hypothesis, Test Design, Variants, Risks and Controls, Analysis Plan) and specific best practices ("Choose one primary metric", "Run tests for full weekly cycles") give usable guidance, but key execution details are missing: no method or formula for the promised "Sample size needed", no recommended significance threshold or power level, and the worked Example is cut off mid-sentence ("Hypothesis (new 1-step flow will increase co..."). That incompleteness keeps it below 4, while the concrete framework keeps it above 2.

3 / 5

Workflow Clarity

The five-part deliverable sequence is clearly enumerated, but the workflow is muddied by the "Instructions" section being framed as a user prompt template ("Help me design an A/B test for [feature/change]" with a "[Add context...]" placeholder) rather than direction to Claude, and the truncated example leaves the intended end-to-end output implicit. It is not 4 because these gaps make the actual execution path ambiguous; it is not 2 because a real, ordered structure is present.

3 / 5

Progressive Disclosure

The body is a self-contained ~60-line document with clear section headers and no external bundle files (no references/, scripts/, or assets/ exist), so nothing is buried or nested. It misses 5 because of organization gaps: duplicate "When to Use" content and generic filler sections ("Domain Context", "Input Requirements") that dilute the overview.

4 / 5

Total

13

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong: third-person, concise, and it clearly pairs a concrete capability statement with an explicit, multi-trigger "Use when" clause. The main gap is that it undersells the skill's specific capabilities (hypotheses, sample sizing, analysis plans), which limits specificity and leaves a couple of natural trigger synonyms uncovered.

Suggestions

Expand the capability statement to name the concrete deliverables, e.g. "Design robust A/B tests with hypotheses, success metrics, sample size calculations, and analysis plans."

Add natural trigger synonyms such as "running an experiment", "split testing", or "deciding between design variants" to the Use-when clause.

DimensionReasoningScore

Specificity

"Design robust A/B test experiments" names the domain plus one concrete action, but the description omits the skill's other capabilities spelled out in the body (hypothesis formulation, sample size calculation, analysis plans). It is not score 2 because it goes beyond a bare generic statement, and not score 4 because coverage of concrete actions is limited to a single verb with the fluffy qualifier "robust".

3 / 5

Completeness

It explicitly answers both questions: "what" via "Design robust A/B test experiments" and "when" via the concrete "Use when testing a new feature, validating a hypothesis, or optimizing conversion rates" clause. This matches the top anchor of a clear what plus an explicit when with concrete trigger phrases, so it is not 4 (the when is already specific, not in need of improvement).

5 / 5

Trigger Term Quality

"testing a new feature, validating a hypothesis, optimizing conversion rates" are natural phrases users would say when they need this skill. It falls short of 5 because common synonyms like "A/B testing", "experiment", "split test", or "rollout" are not present as trigger terms.

4 / 5

Distinctiveness Conflict Risk

A/B test design is a distinct niche with mostly unambiguous triggers, but "validating a hypothesis" and "testing a new feature" are broad enough to overlap with general experimentation or QA-style testing skills. Minor overlap risk places it at 4 rather than 5.

4 / 5

Total

16

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

saski/arnesto

Path

.agents/skills/ab-test-designer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.