CtrlK
BlogDocsLog inGet started
Tessl Logo

ab-test-setup

Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

39

Quality

37%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.agent/skills/ab-test-setup/SKILL.md
SKILL.md
Quality
Evals
Security

A/B Test Setup

1️⃣ Purpose & Scope

Ensure every A/B test is valid, rigorous, and safe before a single line of code is written.

  • Prevents "peeking"
  • Enforces statistical power
  • Blocks invalid hypotheses

2️⃣ Pre-Requisites

You must have:

  • A clear user problem
  • Access to an analytics source
  • Roughly estimated traffic volume

🧠 Knowledge Modules (Fractal Skills)

1. Hypothesis Quality Checklist

2. 3️⃣ Hypothesis Lock (Hard Gate)

3. 4️⃣ Assumptions & Validity Check (Mandatory)

4. 5️⃣ Test Type Selection

5. 6️⃣ Metrics Definition

6. 7️⃣ Sample Size & Duration

7. 8️⃣ Execution Readiness Gate (Hard Stop)

8. During the Test

9. Analysis Discipline

10. Interpretation Outcomes

11. Test Record (Mandatory)

Repository
Dokhacgiakhoa/antigravity-ide
Last updated
First committed

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.