CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

confirmation-testing-workflow

Procedure for proving that a claimed defect fix actually reached the build under test and actually works. Covers the merge-base ancestry check that proves the running build contains the fix commit rather than trusting a version label, the priority order for choosing which reproduction to re-run, and the VERIFIED / NOT FIXED / BLOCKED verdict table whose governing rule is that any ambiguous, flaky, or unreproducible result resolves to BLOCKED and is never guessed. Scoped to ISTQB confirmation testing (does this specific fix work?), not regression testing (did the fix break something else?), and not triage or severity assignment. Use when a developer has marked a defect Fixed and someone must decide whether it moves to Verified or back to Reopened.

1.03x
Quality

94%

Does it follow best practices?

Impact

100%

1.03x

Average score across 10 eval scenarios

SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/confirmation-testing-workflow

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally well-engineered procedure document: fully executable commands, tabulated validation at every step with explicit BLOCKED routing for every ambiguity, and a clean inline/reference split. The only cost is a handful of rhetorical sentences that restate the governing rule and could be trimmed for token efficiency.

Suggestions

Trim the motivational framing in Step 1 and Step 3 ('This is the step teams skip, and skipping it produces both false... verdicts', 'BLOCKED is not a failure of the procedure...') — the exit-status and verdict tables already encode these rules, so the prose restates them at token cost.

The 'Confirmation testing is not regression testing' section could drop the syllabus citation sentence ('the Foundation Level syllabus v4.2 §2.2.3 pairs the two activities...') since the glossary links and the consequence sentence already carry the distinction.

DimensionReasoningScore

Conciseness

The body is dense and expert-level with no basic-concept padding (no 'git is a version control system' filler), and the rationale prose usually changes a decision (e.g. 'a green regression suite is not confirmation the defect is fixed'). Not 5: several motivational/stylistic sentences could be trimmed — 'This is the step teams skip', 'BLOCKED is not a failure of the procedure, it is the correct output', 'Blaming the fix for a deployment gap costs a real reopen cycle' — which restate the governing rule already in the verdict table. Not 3: nothing explained is something Claude already knows at this depth, and every section carries procedural weight.

4 / 5

Actionability

Fully executable guidance throughout: a copy-paste bash block for the ancestry check with a case statement handling all three exit statuses, a numbered priority list for choosing the reproduction, a verdict table specifying exact evidence attachments, and a complete markdown output template with every field named. Not 4: there are no gaps — even the manual tier specifies converting report steps into 'a numbered re-verification script (precondition, steps 1..N, expected result per step)'.

5 / 5

Workflow Clarity

Three explicitly sequenced steps, each with a built-in validation checkpoint and feedback loop: the ancestry-check exit-status table maps every outcome to a verdict consequence, disqualifier checks (flaky tests, never-red reproductions) gate Step 2, and every failure mode routes to BLOCKED with the named action that would clear it. Not 4: validation is explicit and tabulated at every step, not just 'most checkpoints present'.

5 / 5

Progressive Disclosure

The core decision procedure (steps, verdict table, output shape) is appropriately inline at ~200 lines, while the worked example and anti-pattern table are split into a clearly signaled one-level-deep reference that exists in the bundle (references/examples.md) and is linked as '[references/examples.md](references/examples.md)'. Not 4: the split is exactly right — procedural rules in SKILL.md, illustrative material external — with no buried or nested references.

5 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly answers what (the full three-part verification procedure) and when (the Fixed-to-Verified decision point), with deliberate boundary fencing against regression testing and triage. The only gap is a few natural synonyms (retest/retesting, bug) that users might say when invoking it.

Suggestions

Add the synonyms users naturally say for this activity — 'retest', 'retesting', 'bug fix' — to broaden trigger-term coverage, e.g. 'the retest/reproduction to re-run'.

Consider shortening the sentence explaining the verdict table's governing rule ('whose governing rule is that any ambiguous, flaky, or unreproducible result resolves to BLOCKED and is never guessed') to 'and the VERIFIED / NOT FIXED / BLOCKED verdict rule that ambiguous or flaky results resolve to BLOCKED' to cut tokens without losing triggers.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions: 'proving that a claimed defect fix actually reached the build under test and actually works', 'the merge-base ancestry check', 'the priority order for choosing which reproduction to re-run', and 'the VERIFIED / NOT FIXED / BLOCKED verdict table' — comprehensively covering every phase of the procedure in third person. Not 4: coverage is complete across all three workflow steps, not just 'several specific actions with minor gaps'.

5 / 5

Completeness

Both questions are answered explicitly: 'what' is the full procedure summary (ancestry check, reproduction priority, verdict table) and 'when' is a concrete trigger phrase — 'Use when a developer has marked a defect Fixed and someone must decide whether it moves to Verified or back to Reopened.' Not 4: the 'when' clause is explicit and scenario-specific, not merely present-but-imprecise.

5 / 5

Trigger Term Quality

Good natural keyword coverage: 'defect fix', 'Fixed', 'Verified', 'Reopened', 'reproduction', 're-run', 'confirmation testing' — the closing trigger phrase 'Use when a developer has marked a defect Fixed' mirrors how a user would phrase the request. Not 5: common synonyms users naturally say, such as 'retest'/'retesting' (the ISTQB synonym, which the body mentions but the description omits) and 'bug fix', are missing.

4 / 5

Distinctiveness Conflict Risk

The description actively fences its niche: 'Scoped to ISTQB confirmation testing (does this specific fix work?), not regression testing (did the fix break something else?), and not triage or severity assignment' — explicitly disambiguating the three adjacent skills most likely to collide. Not 4: the overlap risk is not just 'minor' but named and ruled out, giving minimal conflict risk.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

testland/qa

Path

plugins/qa-defect-management/skills/confirmation-testing-workflow/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.