CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ai-regression-testing

Regression testing strategies for AI-assisted development. Sandbox-mode API testing without database dependencies, automated bug-check workflows, and patterns to catch AI blind spots where the same model writes and reviews code. Use when adding regression coverage to AI-assisted code, or when the same model both wrote and reviewed a change.

66

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Highly actionable and workflow-solid: executable code, explicit validation gates, and a well-designed fix-to-regression-test feedback loop. The main weaknesses are redundancy (narrative, table, and DO/DON'T restating the patterns) and a single-file structure that inlines setup and command material a leaner SKILL.md would push to reference files.

Suggestions

Trim the four-fix production narrative to the one-line conclusion (sandbox/production path inconsistency is the top AI regression) — the patterns section already demonstrates the failure modes concretely.

Move the vitest config, setup, and test-helper code plus the .claude/commands/bug-check.md definition into a references/ file (e.g., references/setup.md and references/bug-check-command.md), keeping SKILL.md as a lean overview with one-level-deep links.

Deduplicate the Quick Reference table and DO/DON'T list against the Common Regression Patterns section — consolidate into a single summary so each point appears once.

DimensionReasoningScore

Conciseness

Mostly efficient and skill-specific, but the four-fix production narrative ('Fix 1... Fix 4') runs long, and the Quick Reference table and DO/DON'T list substantially restate the Common Regression Patterns section. Not 4 because these redundancies and the extended narrative could be meaningfully trimmed; not 2 because there is no explanation of concepts Claude already knows and the bulk is earned content.

3 / 5

Actionability

Fully executable throughout: complete vitest.config.ts, setup.ts, test helpers, a runnable regression test, concrete commands ('npm run test', 'npm run build'), and a copy-paste-ready .claude/commands/bug-check.md definition covering the common cases (sandbox parity, SELECT omission, error leakage, rollback).

5 / 5

Workflow Clarity

The bug-check workflow is explicitly sequenced with mandatory validation gates ('mandatory, cannot skip', 'Only proceed to Step 2 if both pass'), mechanical failure branches for each step, and a feedback loop (each fix gets a regression test that the next bug-check verifies). Not 4 because checkpoints and error-recovery paths are fully explicit rather than minor-gapped.

5 / 5

Progressive Disclosure

In-body structure is good (clear sections, patterns, quick reference), but this is a ~380-line single-file skill with no bundle: the full vitest config, test-helper code, and the command-file definition are inlined where one-level-deep reference files would fit. Not 2 because sections are well-organized and navigable rather than a monolithic wall; not 4 because content that clearly belongs in separate files (setup code, command definition) is inline with no references.

3 / 5

Total

16

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete third-person capability statements, an explicit 'Use when...' clause with two distinct triggers, and a clear niche in AI-assisted regression testing. Minor room to tighten keyword coverage with more natural synonyms.

DimensionReasoningScore

Specificity

Lists several concrete actions — 'Sandbox-mode API testing without database dependencies', 'automated bug-check workflows', 'patterns to catch AI blind spots' — in third person, with minor gaps in coverage (the underlying testing patterns themselves are not enumerated). Not 5 because coverage of capabilities is good but not comprehensive; not 3 because it clearly goes beyond naming just 1-2 actions.

4 / 5

Completeness

Explicitly answers both what ('Regression testing strategies for AI-assisted development. Sandbox-mode API testing... automated bug-check workflows...') and when ('Use when adding regression coverage to AI-assisted code, or when the same model both wrote and reviewed a change') with concrete trigger phrases.

5 / 5

Trigger Term Quality

Includes natural phrases users would say — 'regression testing', 'bug-check', 'sandbox-mode', 'adding regression coverage' — giving good keyword coverage. Not 5 because a few natural variations (e.g., specific agent tool names, 'write tests for AI changes') are missing; not 3 because the terms go beyond a single generic domain keyword.

4 / 5

Distinctiveness Conflict Risk

The AI-assisted-regression-testing niche with the 'same model writes and reviews code' framing is mostly distinct with clear triggers. Not 5 because it could still mildly overlap with general testing/regression skills; not 3 because the AI-blind-spot angle is specific and uncommon.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Repository

affaan-m/ECC

Path

skills/ai-regression-testing/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.