CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/schemathesis-fuzzing

Use for any request to generate API tests from an OpenAPI or GraphQL schema, or to find inputs that make an API return 500 that hand-written tests miss: Schemathesis fuzzes every endpoint for 5xx errors and schema violations from the CLI or pytest, picks the conformance checks and gates CI as the API evolves.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-crafted skill body: copy-paste-ready CLI and pytest guidance, current version-specific flag information placed appropriately, and clean separation of deep CI/auth wiring into a single verified one-level-deep reference. The only improvement area is trimming the redundancy between 'How to use', 'Install', and 'Running via CLI'.

DimensionReasoningScore

Conciseness

The body is dense and mostly token-efficient (tables of flags, checks, and anti-patterns carry operational info Claude would not know, e.g. the 3.x flag deprecations), but the Install section and the basic 'schemathesis run <schema-url>' invocation repeat steps already given in 'How to use'. Efficient with minor instances that could be trimmed, matching the 4 anchor.

4 / 5

Actionability

Fully executable throughout: a copy-paste-ready worked CLI example with flags and auth header, a complete runnable pytest snippet ('@schema.parametrize()' + 'case.call_and_validate()'), concrete check names, and an anti-patterns table with specific fixes. Matches the 5 anchor; the <schema-url> placeholders are inherent, not gaps.

5 / 5

Workflow Clarity

The 'How to use' section gives a clear 4-step sequence with validation checkpoints (reproduce failures from the printed curl command + Hypothesis seed, triage every shrunk failure, always target staging), and the CI section defines per-PR/nightly cadence. It sits between 4 and 5: most checkpoints are present but the failure-triage error-recovery loop and full CI workflow are delegated to the reference file rather than explicit inline, so 4.

4 / 5

Progressive Disclosure

SKILL.md is a clear overview and the advanced material (GitHub Actions workflow, cadence table, before_call auth hooks) is split into exactly one well-signaled, one-level-deep file (references/ci-and-pytest-integration.md), which exists and contains real content with no nested references. Each of the three inline pointers describes what lives in the reference, matching the 5 anchor.

5 / 5

Total

18

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it pairs an explicit 'Use for...' trigger clause with concrete, third-person capability statements and distinctive 5xx-finding triggers. The only weaknesses are a slightly vague phrase ('picks the conformance checks') and missing common synonyms such as 'Swagger' or 'property-based testing'.

DimensionReasoningScore

Specificity

Lists several concrete actions ('fuzzes every endpoint for 5xx errors and schema violations from the CLI or pytest', 'picks the conformance checks and gates CI') with only minor vagueness ('picks the conformance checks' is slightly unclear about who picks). Between the 4 and 5 anchors: comprehensive but with a small gap, so 4.

4 / 5

Completeness

Explicitly answers both: 'Use for any request to generate API tests from an OpenAPI or GraphQL schema, or to find inputs that make an API return 500...' (when, with concrete triggers) and 'Schemathesis fuzzes every endpoint for 5xx errors and schema violations...' (what). Clearly matches the 5 anchor.

5 / 5

Trigger Term Quality

Strong natural phrases users would say ('generate API tests', 'find inputs that make an API return 500', 'hand-written tests miss', OpenAPI, GraphQL, pytest, fuzzes), but common synonyms like 'Swagger' and 'property-based testing' are absent. Good keyword coverage with a few natural terms missing, matching the 4 anchor.

4 / 5

Distinctiveness Conflict Risk

Clear niche (schema-derived property-based fuzzing for 5xx/conformance) with a named tool and distinct triggers that separate it from example-based API testing skills. Minimal conflict risk, matching the 5 anchor; not 4 because no meaningful overlap risk with closely related skills is evident.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page