CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

qa-chaos-monkey

Adversarial QA tester that systematically tries to break an application's API. Tests security boundaries, input validation, race conditions, deduplication, and malformed requests. Reports bugs with full reproduction details. Trigger on "break the API", "chaos monkey", "adversarial testing", "security test the endpoints", "test edge cases", or when a test plan defines API endpoints.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an actionable, well-structured adversarial-testing playbook with concrete code, a strict output contract, and clear mode routing. Its main defect is that the progressive-disclosure chain is broken: all six rules files the content depends on are absent from the bundle, so the load-bearing detail lives in files the agent cannot read. Workflow validation is mostly present but lacks a pre-flight reachability check.

Suggestions

Include the referenced rules/ files in the bundle (rules/std-test-plan.md, rules/sec-auth.md, rules/sec-input.md, rules/edge-dedup.md, rules/edge-race.md, rules/rpt-bug.md, rules/_sections.md), or inline the essential rule content into SKILL.md if the bundle is meant to be self-contained.

Add a pre-flight validation step to the Workflow section (e.g., verify QA_API_URL resolves and a GET on the base URL responds before launching the full test batch) so batch runs fail fast with a clear cause.

Trim the Persona section and the Workflow section, which restate the intro and Mode A steps, to reduce token cost without losing clarity.

DimensionReasoningScore

Conciseness

The body is efficient — mode detection as a table, terse test-category lists, one copy-paste bash block, and a structured output template — with no padding explaining concepts Claude already knows. Not 5: the 'Persona' section and the 'Workflow' section partially restate the intro and Mode A steps, so a few tokens could be trimmed.

4 / 5

Actionability

Guidance is fully executable: the HMAC-signing bash block is copy-paste ready, the output format is a fill-in template with exact fields ('Result: Expected | BUG | Unclear', 'Severity: BLOCKER | HIGH | MEDIUM | LOW'), Mode A enumerates six concrete test categories with example attacks per category, and the Troubleshooting section pairs each error with cause and solution. Not 4: concrete commands, templates, and worked examples cover the common cases, matching anchor 5.

5 / 5

Workflow Clarity

The three modes are clearly sequenced; Mode A gives a numbered procedure with an explicit per-test recording checkpoint ('Record every attempt with input, response, and resulting state', 'Record everything — even tests that don't find bugs') and a per-test classification step in the output format, plus error-recovery guidance in Troubleshooting. Not 5: minor validation gaps remain — no explicit pre-flight check that the API is reachable/smoke-testable before a full batch run, and no re-check loop after bugs are filed.

4 / 5

Progressive Disclosure

Structure is well organized — a rules table maps each concern to a file and impact level, references are clearly signaled and only one level deep — but every referenced bundle file ('rules/std-test-plan.md', 'rules/sec-auth.md', 'rules/sec-input.md', 'rules/edge-dedup.md', 'rules/edge-race.md', 'rules/rpt-bug.md', 'rules/_sections.md') is missing: the bundle contains no rules/, references/, scripts/, or assets/ directories at all. Scored against the actual bundle structure, the disclosure chain is broken — navigation points to nonexistent files — which is worse than anchor 4's 'minor organization gaps' and fits anchor 3's incomplete organization.

3 / 5

Total

16

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person voice, specific capability list, and an explicit multi-phrase trigger clause covering natural user language. The only gaps are a few missing synonyms (fuzzing, negative testing) and slightly broad trigger phrases that create minor overlap risk with generic security-testing skills.

DimensionReasoningScore

Specificity

The description lists multiple concrete, specific actions — 'Tests security boundaries, input validation, race conditions, deduplication, and malformed requests', 'systematically tries to break an application's API', 'Reports bugs with full reproduction details' — giving comprehensive coverage of the skill's capabilities. Not 4: coverage is broad and each action is concrete, not leaving minor gaps.

5 / 5

Completeness

Both questions are explicitly answered: what ('adversarial QA tester that systematically tries to break an application's API... Reports bugs with full reproduction details') and when ('Trigger on "break the API", "chaos monkey", ... or when a test plan defines API endpoints') with concrete trigger phrases. Not 4: the 'when' clause is not merely present but lists five concrete trigger phrases plus a contextual condition, matching anchor 5 exactly.

5 / 5

Trigger Term Quality

Natural trigger phrases are present and phrased as a user would say them: "break the API", "chaos monkey", "adversarial testing", "security test the endpoints", "test edge cases", plus the contextual condition "when a test plan defines API endpoints". Not 5: common synonyms like "fuzz", "negative testing", or "pen test" are missing, which anchor 4 ("a few natural terms missing") fits better than anchor 5's comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

The niche is distinct — 'chaos monkey' and 'break the API' clearly separate this from general QA or code-review skills. Not 5: broader phrases like 'test edge cases' and 'security test the endpoints' carry minor overlap risk with generic security-audit or endpoint-testing skills, fitting anchor 4 ('minor overlap risk with closely related skills').

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

Total

15

/

16

Passed

Repository

ravnhq/ai-toolkit

Path

.claude-plugin/plugins/qa-chaos-monkey/skills/qa-chaos-monkey/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.