CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/defect-escape-taxonomy

Use when a defect has been confirmed in production and the team must name which class of gap let it through before deciding what to build. Classifies it as a test, process or tooling gap and one of thirteen sub-patterns at the earliest layer that should have caught it, with the fix, without blame.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is exceptionally actionable and workflow-safe: an ordered classification rule, concrete sub-pattern tables, executable example code, and built-in verification steps. Its main cost is token weight — roughly a third of the prose is cultural rationale and quotations that a competent model could be trusted to apply from a one-line constraint, and the reference split stops just short of ideal.

Suggestions

Condense the blameless-constraint section to the two mechanical habits plus a one-line constraint statement; the multi-paragraph SRE and Etsy quotations and the "Note the second row carefully" restatement in Rejected findings can be cut or moved behind the reference without losing enforceability.

Move the full worked example (or at least the process-gap/tooling-gap one-liners and the code block) into a references file, keeping only the classification-rule walkthrough inline, so SKILL.md reads as the overview the progressive-disclosure anchor expects.

Trim the repeated ISTQB definitional quotations (defect, escaped defect, root cause, confirmation testing, defect detection percentage) to short inline citations; the definitions themselves are not needed to execute the procedure.

DimensionReasoningScore

Conciseness

The tables, classification rule, and procedure are tight, but the blameless-constraint section carries long verbatim SRE and Etsy quote blocks and re-explains blameless postmortem culture, and the "Rejected findings" section restates the generic-asset point twice. Mostly efficient with some unnecessary explanation matches anchor 3; it is not anchor 2 because the majority of sections carry no padding and no basic-concept tutorials.

3 / 5

Actionability

The body gives a stop-at-first-yes three-step rule, sub-pattern tables with concrete typical fixes, a seven-step procedure, a mechanical blame scan with specific search strings ("skip", "only", "xfail", "continue-on-error: true"), and a fully executable vitest regression test in the worked example. Guidance is copy-paste ready and covers the common cases, matching anchor 5.

5 / 5

Workflow Clarity

The seven-step procedure is clearly sequenced with explicit validation checkpoints: step 6 verifies the proposed asset would have failed against the introducing commit ("An asset that would have passed against the buggy code is not a prevention asset"), and step 7 mandates a blame scan where every hit is a rewrite, not a softening — a concrete feedback loop. This matches the anchor 5 pattern of sequence plus explicit validation with error-recovery guidance.

5 / 5

Progressive Disclosure

The per-defect document template is appropriately offloaded to a real, clearly signaled, one-level-deep reference (references/escape-defect-document-template.md, verified to exist with no nested references), and the body is well sectioned. Anchor 5 is not reached because substantial inline material — the quote-heavy blameless rationale and the full worked example — could live in references, leaving SKILL.md as a leaner overview; that minor organization gap matches anchor 4.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it explicitly states both what the skill produces (a three-way classification with thirteen sub-patterns, earliest catching layer, and fix) and when to use it, in third person, without fluff. Its only weakness is trigger-term coverage — users who say "bug escaped", "postmortem", or "root cause" would not match it lexically.

DimensionReasoningScore

Specificity

"Classifies it as a test, process or tooling gap and one of thirteen sub-patterns at the earliest layer that should have caught it, with the fix" lists multiple concrete actions covering the skill's full scope (category, sub-pattern, layer, fix, blameless constraint). Anchor 4 requires minor gaps in coverage, but the action inventory is complete for this single-purpose skill, so 5 fits best.

5 / 5

Completeness

The explicit "Use when a defect has been confirmed in production and the team must name which class of gap let it through before deciding what to build" clause answers 'when' with concrete conditions, and the classification output is stated clearly. Both what and when are explicit with concrete triggers, matching anchor 5 rather than the merely-adequate anchor 4.

5 / 5

Trigger Term Quality

Natural terms like "defect", "confirmed in production", "test, process or tooling gap", and "fix" are present, but common user phrasings such as "bug", "escaped defect", "postmortem", or "root cause" are missing. Good coverage with a few natural terms absent matches anchor 4 rather than the synonym-complete anchor 5.

4 / 5

Distinctiveness Conflict Risk

The niche — naming which class of checking gap let a confirmed production defect through, "before deciding what to build" — is distinct and unlikely to fire for general incident-response or bug-fixing skills. Minimal conflict risk matches anchor 5; anchor 4's "minor overlap risk" would apply if a closely related skill shared its triggers.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page