CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

qa-test-the-tester

Measure the bug tester's and test suite's real detection power with seeded bugs, mutation testing, and recall scoring. Use when adopting the tester, after changing its instructions, or periodically.

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally lean, well-sequenced instruction skill: concrete tools, counts, metrics, explicit feedback loops, and audits that validate the testing process itself. The only notable gap is that internal components (kitcheck, the harness, the pattern library) are named without commands or paths, leaving small execution gaps.

Suggestions

Add a one-line pointer or command for the referenced components (kitcheck, the harness, the pattern library) so the procedures are directly executable rather than relying on inference from the parent kit.

DimensionReasoningScore

Conciseness

Every line is instruction, not explanation — concrete bug patterns, counts ("10–20 known bugs", "three rounds"), and metrics ("recall (found/planted), false positives, and time to find") with zero padding or concepts Claude already knows. Assumes Claude's competence throughout; nothing can be trimmed without losing information.

5 / 5

Actionability

Concrete specifics throughout — named tools ("Stryker for JS/TS/.NET, mutmut for Python"), defined metrics, and a difficulty-escalation list — but "kitcheck", "the harness", and "the pattern library" are referenced with no commands or paths for invoking them. Mostly executable guidance with minor gaps, short of the fully copy-paste-ready 5.

4 / 5

Workflow Clarity

The 5-step procedure, multi-round loop ("Write an improvement plan from every miss, false positive, and failed check. Implement the plan. Rerun all earlier rounds' suites as well as the new one"), honesty/gaming audits, and the exit-criteria checklist give explicit validation steps, feedback loops, and a checklist — matching the top anchor rather than the 4, where validation is only mostly present.

5 / 5

Progressive Disclosure

A sub-50-line, single-purpose skill with no bundle files and no need for external references; sections are well organized (Procedure / Exit criteria / Multi-round improvement / Escalated bugs) and the one external link is clearly signaled and one level deep. Meets the simple-skill exception for a top score.

5 / 5

Total

19

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete methods, explicit and specific use-conditions, and third-person voice in a niche that is unlikely to trigger for the wrong skill. Its only weaknesses are slightly incomplete action coverage (audits unmentioned) and a few missing natural keyword variations.

Suggestions

Mention the honesty and gaming audits in the description so the stated capabilities match what the skill actually performs.

Add one or two natural user phrasings such as 'evaluate the test suite' or 'test the tester' to broaden trigger-term coverage.

DimensionReasoningScore

Specificity

Lists three concrete methods ("seeded bugs, mutation testing, and recall scoring") but omits the honesty and gaming audits the skill also performs — minor gaps in coverage, so it fits the 'several specific actions with minor gaps' anchor rather than the comprehensive 5.

4 / 5

Completeness

Explicitly answers both: what — "Measure the bug tester's and test suite's real detection power with seeded bugs, mutation testing, and recall scoring"; when — "Use when adopting the tester, after changing its instructions, or periodically", with three concrete trigger conditions. The when-clause is fully explicit, so it exceeds the 4 anchor where 'when' could be more specific.

5 / 5

Trigger Term Quality

Includes natural phrases users would say ("seeded bugs", "mutation testing", "recall", "adopting the tester"), but misses common variations like "test the tester", "evaluate test quality", or "QA". Good coverage with a few natural terms missing, not the synonym/extension-level comprehensiveness of the 5 anchor.

4 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (evaluating the tester rather than testing software) with distinct triggers, but "test suite" and "bug tester" create minor overlap risk with a general write/run-tests skill. Mostly distinct with minor overlap, not the minimal-conflict 5.

4 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

itsablabla/qa-bug-agent-skills

Path

skills/qa-test-the-tester/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.