CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

qa-api-contract

Test REST, GraphQL, and webhook APIs for contract conformance, input fuzzing, error semantics, idempotency, pagination, and rate limits using schema-driven and property-based tools. Use when an app exposes or consumes APIs or webhooks.

76

Quality

96%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

93%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally lean, actionable testing procedure with concrete commands, exact fuzz inputs, expected status codes, and an explicit exit-criteria validation gate. The only soft spots are the absence of mid-procedure checkpoints/feedback loops and a few cryptic project-local references ('Round 3', 'the manifest', 'pattern C1') that are unresolvable from the skill itself.

Suggestions

Add a mid-procedure checkpoint to the Procedure (e.g., after step 1: verify the derived schema loads and every endpoint is reachable before running Schemathesis) and a short feedback loop for failures (re-derive the contract or narrow the endpoint set, then re-run) to lift workflow_clarity to the 5 anchor.

Resolve or inline the project-local references — 'rate limited to the manifest', '(another user's email was exposed in Round 3)', and 'pattern C1' — with a one-phrase explanation or a pointer to a real reference file, since a fresh reader cannot act on them.

DimensionReasoningScore

Conciseness

The body is lean and dense — every step adds project-specific directives (expected status codes, exact fuzz values, tool names) with zero padding or explanation of concepts Claude already knows, matching the 5 anchor where every token earns its place; it is above the 4 anchor because there is no over-explanation to trim (the brief 'Round 3' aside is a one-line lesson that still informs step 9).

5 / 5

Actionability

It provides a copy-paste Schemathesis command with exact flags, named tools (fast-check, Hypothesis), exact input fuzz values ('empty, whitespace, very long, wrong type, and Unicode'), and expected outcomes (401, 403/404, 4xx-not-500), covering the common cases concretely; per the rubric's instruction-only note, absence of more code is not penalized since the guidance is highly actionable. It sits at the 5 anchor rather than the 4 anchor's 'minor gaps' because the remaining gaps (no HAR-reconstruction command, no property-test snippet) are trivial against the coverage provided.

5 / 5

Workflow Clarity

The 10 steps are clearly numbered and sequenced, and the 'Exit criteria' section acts as an explicit final validation checklist with result-recording ('recorded status'), plus per-step result interpretation ('Treat 5xx, schema violations, and stateful-link failures as findings'). It is above the 3 anchor because validation is present (so the missing-validation cap does not apply), but below the 5 anchor because there is no mid-procedure checkpoint (e.g., verifying the derived schema loads before fuzzing) and no error-recovery loop like 'fix and re-run'.

4 / 5

Progressive Disclosure

The skill is under 50 lines with no bundle files, and the body is well organized into two clear sections (Procedure, Exit criteria), so per the rubric's simple-skill guideline it scores 5 on well-organized sections alone; nothing is inlined that belongs in a separate file, though the unresolved pointers 'Round 3', 'the manifest', and 'pattern C1' reference context outside the skill.

5 / 5

Total

19

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: specific, dense with natural trigger terms, and explicitly answering both what the skill does and when to use it. Its only weakness is minor overlap risk with general API-testing or security-review skills.

DimensionReasoningScore

Specificity

The description enumerates multiple concrete capabilities — 'contract conformance, input fuzzing, error semantics, idempotency, pagination, and rate limits' — across named API domains (REST, GraphQL, webhooks), matching the anchor for multiple specific concrete actions with comprehensive coverage; it is more complete than the 4 anchor's 'minor gaps in coverage'.

5 / 5

Completeness

Both parts are explicit: the 'what' is the detailed capability list and the 'when' is a concrete trigger clause ('Use when an app exposes or consumes APIs or webhooks'), which meets the 5 anchor's bar of clearly answering both with concrete triggers; it is above the 4 anchor's more generic 'Use when working with PDF files' pattern.

5 / 5

Trigger Term Quality

It covers the natural terms a user would actually say for this domain — 'REST', 'GraphQL', 'webhook', 'API', 'rate limits', 'fuzzing', 'contract' — giving comprehensive keyword coverage rather than the 'a few natural terms missing' state of the 4 anchor.

5 / 5

Distinctiveness Conflict Risk

The niche (schema-driven API contract/fuzz testing) is mostly distinct with specific jargon like idempotency and webhook signatures, but 'Test REST... APIs' still has minor overlap risk with general testing or code-review skills, fitting the 4 anchor better than the minimal-conflict 5 anchor.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

itsablabla/qa-bug-agent-skills

Path

skills/qa-api-contract/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.