CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment-results-interpreter

Use when an A/B test result is read for a ship decision, especially off a dashboard, a small sample or many metrics. Computes significance per metric with multiple-comparison correction, reads confidence intervals, checks novelty, interactions, Simpson's paradox, guardrails and stop-early rules.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/experiment-results-interpreter

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured interpretive workflow: six ordered hard-stop steps with concrete decision tables, explicit stop conditions, a complete worked example, an anti-pattern catalog, and honest limitations. Depth is properly offloaded to real one-level-deep reference files; the only gaps are two unsurfaced bundle files and minor definitional padding.

DimensionReasoningScore

Conciseness

The body is dominated by decision tables, thresholds, and gate rules that earn their tokens, with only minor trimmable asides (the Wikipedia definition of Simpson's paradox, a basic explanation of what a 95% CI gives, and inline citation quotes). This fits the 4 anchor (efficient, minor over-explanation) rather than 3, since the padding is incidental rather than structural, and rather than 5 because those asides exist.

4 / 5

Actionability

Concrete guidance throughout: pass criteria per check, an ordered guardrail procedure with STOP conditions, hard numeric rules ("Do not ship on a positive aggregate with a negative segment that represents > 20% of users"), and a fully worked example with real numbers. It falls at 4 rather than 5 because computation detail is delegated to references/significance-check.md and a few checks remain heuristic directives ("Audit the concurrent experiment list").

4 / 5

Workflow Clarity

"Each step has a hard stop: if a step blocks, do not proceed to the next" establishes an explicit six-step sequence where every step is a validation gate with STOP/no-ship conditions, plus extend-or-block recovery options and a worked example that walks all six steps. This matches the 5 anchor (explicit validation steps, feedback loops, checklists); 4 would require some checkpoints to be merely implicit, which they are not.

5 / 5

Progressive Disclosure

The body is an appropriate overview with all five referenced files (sources, significance-check, guardrails, thresholds-and-corrections, peeking) present in the bundle and exactly one level deep. It sits at 4 rather than 5 because two bundle files (significance-anti-patterns.md, significance-output-example.md) are only reachable via a sibling link inside significance-check.md — with mismatched link text — rather than being surfaced from SKILL.md, and thresholds-and-corrections.md is only mentioned parenthetically.

4 / 5

Total

17

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it uses third person, packs several concrete capabilities into one sentence, and opens with an explicit 'Use when' trigger clause with concrete scenarios. The only weaknesses are a few missing natural synonyms (e.g., "experiment results") and slight overlap potential with generic significance-testing skills.

DimensionReasoningScore

Specificity

"Computes significance per metric with multiple-comparison correction", "reads confidence intervals", and "checks novelty, interactions, Simpson's paradox, guardrails and stop-early rules" list multiple concrete actions that comprehensively cover the skill's six body steps. This matches the 5 anchor rather than 4 because coverage is comprehensive with no gaps, and the voice is consistently third person.

5 / 5

Completeness

An explicit "Use when an A/B test result is read for a ship decision, especially off a dashboard, a small sample or many metrics" clause answers 'when' with concrete triggers, and the multi-action verb chain answers 'what'. Both are clearly and explicitly stated, matching the 5 anchor exactly; 4 would require the 'when' to be less explicit than it is.

5 / 5

Trigger Term Quality

Natural phrases users would say are present ("A/B test result", "ship decision", "dashboard", "small sample", "confidence intervals", "guardrails"), but common synonyms such as "experiment results" or "should we ship" are missing. This fits the 4 anchor (good coverage, a few natural terms missing) rather than 5's comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

The A/B-result-interpretation niche is distinct (and explicitly separated from the ab-test-validity-checklist companion), but phrases like "a small sample or many metrics" and generic statistical terms leave minor overlap risk with a general significance-testing skill. Fits 4 (mostly distinct, minor overlap with closely related skills) rather than 5's minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

testland/qa

Path

plugins/qa-feature-flags/skills/experiment-results-interpreter/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.