CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/schemathesis-fuzzing

Generates property-based API tests automatically from an OpenAPI 2/3.x or GraphQL schema using Schemathesis, runs them via the `schemathesis run` CLI or as a pytest decorator, configures the canonical checks (status_code_conformance, response_schema_conformance, content_type_conformance, response_headers_conformance, not_a_server_error), and gates CI on schema-conformance failures plus 5xx detection. Use when the project ships an OpenAPI or GraphQL schema and the team wants schema-driven coverage that scales as the API evolves.

75

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable body with executable CLI/pytest/CI examples, a clear sequenced workflow with validation checkpoints, and proper one-level-deep progressive disclosure. Its main weakness is conciseness: repeated source attributions and minor section redundancy add tokens without value.

Suggestions

Collapse the repeated 'Per [schemathesis-readme][readme]' attribution clauses — a single source note per section, or relying on the References list, removes ~6 token-heavy interjections.

Merge the standalone 'Install' and 'Running via CLI' sections since both restate basic invocation; keep one concise install/run block.

Trim the overview's blockquote ('automatically generates property-based tests... exercises the edge cases that break your API') — Claude knows what a property-based fuzzer is; lead with what to do, not what the tool is.

DimensionReasoningScore

Conciseness

Content is mostly actionable but padded with repeated 'Per [schemathesis-readme][readme]' attribution clauses (~6 occurrences) and a somewhat redundant Install/Running-via-CLI split, plus an overview quote that re-explains what Schemathesis is; it is not level 1 because the bulk is concrete flags/checks/code rather than concept explanation, and not level 3 because the attributions and minor redundancy could be trimmed.

2 / 3

Actionability

Provides a copy-paste worked CLI example, executable pytest snippet ('@schema.parametrize()' / 'case.call_and_validate()'), a complete GitHub Actions workflow in the reference, and flag/check tables — matching the level-3 anchor for fully executable, copy-paste-ready guidance.

3 / 3

Workflow Clarity

The 4-step 'How to use' sequence includes a validation checkpoint (reproduce any failure from the printed curl + Hypothesis seed), a CI gate as verification, and an Anti-patterns checklist serving as error-recovery feedback; matches the level-3 anchor with explicit checkpoints and a feedback loop.

3 / 3

Progressive Disclosure

SKILL.md is an overview that signals one-level-deep detail to references/ci-and-pytest-integration.md (verified to exist) for CI wiring and hooks, with no nested second-level references; content is appropriately split and easy to navigate, matching the level-3 anchor.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, third-person description that states both concrete capabilities (named checks, CLI/pytest modes, CI gating) and an explicit 'Use when' trigger for OpenAPI/GraphQL-schema projects. It is distinct from example-based testing skills and free of fluff.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Generates property-based API tests', 'runs them via the schemathesis run CLI or as a pytest decorator', 'configures the canonical checks (status_code_conformance, response_schema_conformance, content_type_conformance, response_headers_conformance, not_a_server_error)', 'gates CI on schema-conformance failures plus 5xx detection' — matching the level-3 anchor; it is not level 2 because the actions are comprehensive and named, not just a domain plus partial actions.

3 / 3

Completeness

Explicitly answers 'what' (generates/runs/configures/gates) and 'when' via the 'Use when the project ships an OpenAPI or GraphQL schema and the team wants schema-driven coverage' clause, matching the level-3 anchor; it is not level 2 because the trigger is explicit, not implied.

3 / 3

Trigger Term Quality

Includes natural terms a user would say for this need — 'OpenAPI 2/3.x or GraphQL schema', 'property-based API tests', '5xx', 'schema-driven coverage' — matching the level-3 anchor; it is not level 2 because common variations are covered rather than partial.

3 / 3

Distinctiveness Conflict Risk

Carves a clear niche — property-based schema-driven fuzzing via Schemathesis — with distinct triggers unlikely to fire for example-based testing skills; uses consistent third-person voice ('Generates', 'runs', 'gates') per the voice guideline.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents