CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ab-test-setup

Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

52

Quality

66%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/ab-test-setup/SKILL.md

The canonical home for this skill is ab-test-setup in sickn33/agentic-awesome-skills

SKILL.md
Quality
Evals
Security

Quality

Content

62%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The skill's core strength is its gated, well-sequenced workflow with explicit hard stops, verification checklists, and recovery loops — textbook workflow clarity. Its weaknesses are actionability gaps where directives lack the underlying formulas/templates that already exist unreferenced in the bundle, plus filler sections and boilerplate that pad token cost without adding guidance.

Suggestions

Link the existing bundle files where they are needed: e.g., in §7 point to references/sample-size-guide.md for formulas and duration rules, and in the Documentation section point to references/test-templates.md for the test record templates.

Cut the redundant 'Key Principles (Non-Negotiable)' recap, the 'Final Reminder' motivational section, and the boilerplate 'When to Use'/'Limitations' sections to reclaim tokens.

Add concrete thresholds to the vague directives — e.g., what makes a guardrail 'significantly negative' (alpha level, direction) and what 'traffic is insufficient' means in terms of detectable MDE.

DimensionReasoningScore

Conciseness

The core sections are tight bullet lists that assume Claude's statistical knowledge, but there are several padded pieces: 'Key Principles (Non-Negotiable)' restates earlier gates, 'Final Reminder' is motivational filler, and 'When to Use'/'Limitations' are boilerplate ('This skill is applicable to execute the workflow or actions described in the overview' adds nothing). That is more than 'minor instances' (4), so it sits at 'mostly efficient but could be tightened'.

3 / 5

Actionability

The Tracking Verification checklist is genuinely executable ('confirm it lands within 30 seconds', 'split within ±5% of the configured allocation'), but other sections give directives without the how: §7 says 'Estimate: Required sample size per variant' with no formula, and the Documentation section lists fields with no template — even though a sample-size guide and templates exist in references/ and are never linked. This lands at 'some concrete guidance but incomplete, missing key details' rather than 'mostly executable' (4).

3 / 5

Workflow Clarity

The body delivers a clearly numbered pipeline (§1–§8) with two explicit hard gates ('Do NOT proceed until confirmed', 'You may proceed... only if all are true'), a concrete pre-gate verification checklist, a refusal-conditions section, and explicit recovery loops ('If any item is missing, stop and resolve it'; 'If any of the above fails, stop and resolve it before Gate 8'). This matches the top anchor: clear sequence, explicit validation steps, feedback loops, and checklists.

5 / 5

Progressive Disclosure

The body is well-sectioned with headers, but the two bundle references (references/sample-size-guide.md, references/test-templates.md) are never mentioned anywhere in the body — they are neither signaled nor linked, so their content is undiscoverable from the skill. Per the guideline to score against the actual bundle structure, this fits 'references present but not clearly signaled', keeping it at 3 rather than 4.

3 / 5

Total

14

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description states a clear, third-person 'what' with a distinctive A/B-testing niche, but it omits any 'Use when' trigger guidance and lacks natural synonyms like 'split test' or 'experiment'. It is serviceable but would be substantially more discoverable and complete with an explicit trigger clause.

Suggestions

Append a trigger clause, e.g. 'Use when planning or setting up an A/B test, split test, or experiment, or when the user mentions variants, conversion rates, or statistical significance.'

Add natural synonyms and user-facing vocabulary ('split test', 'experiment', 'variant', 'conversion rate') to improve keyword coverage.

Name one or two more concrete actions (e.g., 'calculating sample size and duration, defining primary and guardrail metrics') to raise specificity.

DimensionReasoningScore

Specificity

The description names the domain ('setting up A/B tests') and the gate objects ('hypothesis, metrics, and execution readiness'), which is roughly one-to-two concrete actions — comparable to 'Processes PDF files and extracts content'. It is not a bare domain mention (2), but it also does not list several specific actions like extracting, filling, or merging (4).

3 / 5

Completeness

The 'what' is clear ('Structured guide for setting up A/B tests with mandatory gates...'), but there is no 'Use when...' clause or equivalent trigger guidance — the rubric explicitly caps completeness at 3 in that case. It is above score 2 because the 'what' is concrete, but below 4 because the 'when' is entirely missing rather than merely imprecise.

3 / 5

Trigger Term Quality

'A/B tests', 'hypothesis', and 'metrics' are relevant natural keywords, but common variations users would say — 'split test', 'experiment', 'conversion rate', 'variant' — are absent. This matches 'Some relevant keywords but missing common variations or synonyms' rather than the near-complete coverage of a 4.

3 / 5

Distinctiveness Conflict Risk

'A/B tests' is a clear niche with specific gate language ('hypothesis, metrics, and execution readiness') giving distinct triggers. It is not a 5 because adjacent skills (general experimentation, analytics dashboarding, statistical analysis) could plausibly overlap, matching 'minor overlap risk with closely related skills'.

4 / 5

Total

13

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

administrakt0r/AI-Agents-Safe-Coding-Skills

Path

skills/ab-test-setup/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.