CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ad-test-designer

Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable instruction body with a clear gated workflow and correct use of one-level-deep reference files. The main weaknesses are repetitive restatement of the decision-ownership rule and incomplete spell-outs of two of the three helper subcommands.

Suggestions

State the decision-ownership rule fully once (step 7) and reduce the restatements in the intro, Skill Contract, and Next Best Skill sections to a single short cross-reference, e.g. "per the decision gate in step 7".

Show full invocation examples for experiment.py's continuous and samplesize subcommands alongside the existing proportion example so all three compute paths are copy-paste ready.

Consolidate the duplicate sibling-skill boundary statements (intro paragraph and Next Best Skill) into the Next Best Skill section only.

DimensionReasoningScore

Conciseness

The body is dense with no explanations of concepts Claude already knows (formulas and the sizing table are pushed to the reference file), but the decision-ownership rule is restated roughly four times (intro, step 7, step 9, Next Best Skill) and the sibling-skill exclusions appear twice. This matches "efficient; minor instances of over-explanation that could be trimmed" rather than the fully lean 5 anchor.

4 / 5

Actionability

Concrete executable guidance is present: a copy-paste-ready command ("python3 \"${CLAUDE_PLUGIN_ROOT}/scripts/connectors/experiment.py\" proportion --control <conv> <n> --variant <conv> <n> --alpha <alpha> --min-lift <relative-bar>"), a fill-in-the-blank hypothesis template, and explicit defaults ("alpha=.05", "power=.80"). It falls short of 5 because the continuous and samplesize subcommands are named but their invocations are not spelled out like proportion's.

4 / 5

Workflow Clarity

Instructions 1–9 form a clear sequence (mode → hypothesis → matrix → metrics → sizing → significance → decision ownership → provenance → binding verification) with explicit validation gates and feedback paths: the step-1 NEEDS_INPUT stop, step 9's "Refuse to combine a result with a different creative/landing hash... A changed binding starts a new test", and the decision gate in step 7. This matches the anchor for clear sequencing with explicit validation and error-recovery loops.

5 / 5

Progressive Disclosure

The ~78-line body is an overview with well-signaled one-level-deep references: both bundle files exist (references/test-design-guide.md, references/measurement-control.md) and each citation states what it contains ("variant matrix, reference sizing table, statistical procedures, and decision-ownership matrix"). The heavy detail is appropriately split out rather than inlined.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete deliverables, natural quoted trigger phrases in two languages, explicit what/when, and active disambiguation from sibling skills in a multi-skill suite. The only gap is missing common English synonyms for the trigger terms.

DimensionReasoningScore

Specificity

The description enumerates multiple concrete deliverables — "produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results" — and adds a concrete governance behavior ("applies only a precommitted owner-approved action rule"). Coverage spans design, read-out, and decision-governance with no gaps, matching the comprehensive-coverage anchor rather than the minor-gaps anchor at 4.

5 / 5

Completeness

Both halves are explicit: what it does (hypothesis, variant matrix, sizing/power plan, documented effect/uncertainty read) and when to use it ("Use when the user asks to..." with concrete trigger phrases), plus explicit negative boundaries. This matches the anchor that clearly answers both what and when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Natural quoted trigger phrases are strong ("design an A/B test", "set up a creative/landing test", "run an incrementality test", "is this result statistically and practically material?") and are supplemented by Chinese keywords. It falls short of the 5 anchor because common English synonyms like "split test", "is this significant", or "power analysis" are absent.

4 / 5

Distinctiveness Conflict Risk

A clear niche (ad experiment design + statistical read-out) with explicit disambiguation: "Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop." Minimal conflict risk with sibling skills.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 13 suspicious

Warning

Total

13

/

16

Passed

Repository

aaron-he-zhu/aaron-marketing-skills

Path

ad/orchestrate/ad-test-designer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.