CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ad-test-designer

Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered skill body: a crisp contract, a sequenced nine-step workflow with explicit validation gates, and an executable statistical helper command. Main weaknesses are restated decision-ownership rules across four sections and a few compute paths that are named without example invocations. Progressive disclosure is solid, with both local reference files present and clearly signaled.

Suggestions

State the decision-ownership rule once authoritatively (e.g., in step 7) and reduce it to a one-line pointer in the intro, Skill Contract, and Next Best Skill sections to cut repeated tokens.

Add short example invocations for 'experiment.py continuous' and 'experiment.py samplesize' alongside the existing 'proportion' example so all compute paths are copy-paste ready.

Move the step 6 statistical-method menu into references/test-design-guide.md, keeping only the selection rule and a pointer inline.

DimensionReasoningScore

Conciseness

The body is mostly lean and assumes competence (e.g., it names 'Two-proportion z-test' and 'Mann-Whitney U' without explaining them), but the decision-ownership rule is restated in the intro, Skill Contract, step 7, and Next Best Skill, which is trimmable repetition. It sits above the 'mostly efficient with some unnecessary explanation' anchor but short of 'every token earns its place'.

4 / 5

Actionability

Concrete, executable guidance includes the copy-paste-ready helper invocation ('python3 "${CLAUDE_PLUGIN_ROOT}/scripts/connectors/experiment.py" proportion --control <conv> <n> ...'), a fill-in hypothesis template, and a specific data-source table. It falls short of the fully-executable anchor because the 'continuous' and 'samplesize' subcommands and the bootstrap/Mann-Whitney paths are named but never exemplified.

4 / 5

Workflow Clarity

Nine numbered steps are clearly sequenced (mode → hypothesis → matrix → metrics → sizing → significance → decision ownership → provenance → binding verification) with explicit checkpoints: the NEEDS_INPUT gate in step 1, the precommitment decision gate in step 7, and the binding-refusal rule in step 9, plus a 'Done when' checklist. Error/recovery paths are explicit rather than implicit, matching the top anchor.

5 / 5

Progressive Disclosure

Good structure with well-signaled, one-level-deep references — both referenced local bundle files (references/test-design-guide.md, references/measurement-control.md) exist — and a dedicated Reference Materials section. It falls short of the top anchor because some statistical detail in step 6 is inlined where the guide file would serve, and several references point outside the skill bundle to files that cannot be verified from it.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit what/when, concrete trigger phrases in the user's own words, comprehensive deliverable coverage, and explicit routing boundaries against sibling skills. The only weakness is missing a few common synonyms (e.g., 'split test') among the trigger terms. The Chinese keyword summary at the end adds bilingual discoverability without hurting clarity.

DimensionReasoningScore

Specificity

The description lists multiple concrete deliverables — 'produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results' — covering the skill's full capability range. It exceeds the 'several specific actions with minor gaps' anchor, matching the comprehensive anchor instead.

5 / 5

Completeness

It explicitly answers 'when' with concrete quoted trigger phrases ('Use when the user asks to...') and 'what' with the full deliverable list, plus negative boundaries. This matches the anchor requiring both what and when with concrete triggers, rather than the merely-adequate anchor.

5 / 5

Trigger Term Quality

Quoted natural trigger phrases like '"design an A/B test"', '"set up a creative/landing test"', and '"run an incrementality test"' mirror what users would actually say. It falls short of the comprehensive anchor because common synonyms such as 'split test', 'A/B/n', or 'experiment' are not included as triggers.

4 / 5

Distinctiveness Conflict Risk

Explicit exclusions — 'Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop' — carve out a clear niche with minimal conflict risk. It is clearly distinct from adjacent measurement/creative skills, matching the clear-niche anchor.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 13 suspicious

Warning

Total

13

/

16

Passed

Repository

aaron-he-zhu/aaron-marketing-skills

Path

ad/orchestrate/ad-test-designer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.