CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

factory-qa

Prove one task's acceptance criteria with observable end-to-end tests against the real product, record a test plan and a test-gap ledger, and capture screenshots for the pull request. Use for the QA stage, after work and before review, when FACTORY.json enables stages.qa.

77

Quality

97%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

100%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Excellent content: specific, lean, and correctly scoped, with an explicit write-run-fix loop, concrete commands and file templates, and clean separation of the main workflow from Playwright details and the output template. No dimension shows a meaningful weakness.

DimensionReasoningScore

Conciseness

Lean and directive throughout: every line is either an instruction, a project-specific constraint, or a non-obvious operational detail ("Prefer `localhost` to `127.0.0.1`, because dev servers often listen on IPv6 only"; "Never use `pkill -f` with a pattern that also appears in your own command line"). No concept explanations Claude already knows and no padding to trim.

5 / 5

Actionability

Fully executable guidance: a copy-paste-ready command ("pnpm exec playwright test <file> --timeout=15000 --max-failures=1"), a concrete pid pattern ("cmd & pid=$!"), complete file templates for test-plan.md and ledger.md with example rows, a screenshot naming convention ("screenshots/ac2-filter-after-reload.png"), and example ledger lines. The only unavoidably abstract parts (the tests themselves) are task-specific and delegated to references/playwright.md, which supplies the concrete patterns.

5 / 5

Workflow Clarity

Clear sequence with explicit validation checkpoints and a feedback loop: read inputs → sort criteria into observable/internal → write one test, "Run only that test", and on failure "read the failure, and only then the product code it points at… Fix the test with a small edit and run it again". The failure-is-a-finding rule ("Do not weaken the assertion and do not change product code") and the closing checklist ("Every criterion must have a row in the test plan or a ledger line with a reason") complete the loop.

5 / 5

Progressive Disclosure

A 73-line overview with well-signaled, one-level-deep references, both verified real: "For Playwright projects, follow [references/playwright.md]" and "Return only the `factory.qa.v1` template in [references/output.md]". Playwright-specific patterns and the output template are appropriately split out of the main file, and the references do not nest further.

5 / 5

Total

20

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, specific, and complete, with an explicit "Use when…" trigger clause tied to a concrete gating condition. The only gap is synonym coverage of natural trigger phrases (e.g. "E2E", "QA testing"), which slightly limits recall.

Suggestions

Add common synonyms for the testing vocabulary, such as "E2E tests" or "QA testing", so the description matches more of the phrases a user or pipeline would naturally use.

Consider naming the trigger artifact variations explicitly (e.g. "when stages.qa is enabled in FACTORY.json") in the most-likely phrasing order to strengthen automated trigger matching.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions that comprehensively cover the skill's capabilities: "prove one task's acceptance criteria with observable end-to-end tests against the real product", "record a test plan and a test-gap ledger", and "capture screenshots for the pull request". No generic filler; not score 4 because the coverage is comprehensive rather than having minor gaps.

5 / 5

Completeness

Clearly answers both what ("Prove one task's acceptance criteria with observable end-to-end tests… record a test plan and a test-gap ledger… capture screenshots") and when ("Use for the QA stage, after work and before review, when FACTORY.json enables stages.qa") with an explicit, concrete trigger clause.

5 / 5

Trigger Term Quality

Good natural keyword coverage: "acceptance criteria", "end-to-end tests", "test plan", "screenshots", "pull request", "QA stage", "FACTORY.json", "stages.qa". Not score 5 because common synonyms and variations are missing (e.g. "E2E tests", "QA testing", "regression"); not score 3 because coverage goes well beyond "some relevant keywords".

4 / 5

Distinctiveness Conflict Risk

Clear niche with distinct, gated triggers: the QA stage of a factory pipeline, positioned "after work and before review" and gated on "FACTORY.json enables stages.qa". It names skill-specific artifacts (test-gap ledger) that no generic testing or review skill would claim, so conflict risk is minimal.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

geut/factory-skills

Path

skills/factory-qa/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.