Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A strong, highly actionable skill body: executable commands throughout, dense reference tables, thoughtful anti-patterns and limitations, and a clean split between the inline overview and a single well-signaled reference file. The main improvement opportunities are removing the duplicated install/run material and making validation steps more explicit in the main workflow.
Suggestions
Fold the Install section into 'How to use' step 2 — the pip and uvx commands are already stated there — and drop the explanation of what uvx is to remove the duplication.
Promote validation to explicit numbered checkpoints in 'How to use' (e.g., 'Step 3b: reproduce any failure via the printed curl command + Hypothesis seed before proceeding to the CI gate') so the feedback loop is visible in the sequence itself.
The basic invocation `schemathesis run <schema-url>` appears in both step 3 of 'How to use' and the 'Running via CLI' section; state it once and keep the detailed flags in the CLI section.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is largely dense and earning its tokens (flags table, checks table, anti-patterns table, worked example) with no padding explaining basic concepts, but there are trimmable redundancies: the pip/uvx install commands appear both in "How to use" step 2 and again in a separate Install section, and it explains what `uvx` is ("the `uv` runner for one-off tool execution") — something Claude already knows. This sits at anchor 4 ("efficient; minor instances of over-explanation") rather than anchor 3, since the over-explanation is incidental rather than pervasive. | 4 / 5 |
Actionability | Everything is executable and copy-paste ready: `pip install schemathesis` / `uvx schemathesis run <schema-url>`, a fully populated worked CLI example with real flag values, exact check names (`status_code_conformance`, `not_a_server_error`, ...), a runnable pytest snippet, and a complete GitHub Actions workflow in the reference. Anchor 5's "specific examples cover the common cases" is met (basic run, strict run, 5xx-only smoke test, pytest integration, CI). | 5 / 5 |
Workflow Clarity | The 4-step "How to use" sequence is clear and safety-conscious (run against staging, never prod — reinforced by the anti-patterns table), and includes a genuine error-recovery mechanism ("reproduce any failure from the printed `curl` command + Hypothesis seed", "Triage every failure"). It falls short of anchor 5 because validation is woven into prose rather than appearing as explicit numbered checkpoints with feedback loops, leaving minor gaps like when to re-run after a schema amendment. | 4 / 5 |
Progressive Disclosure | The SKILL.md body is a well-organized overview that keeps deep CI wiring and auth hooks in references/ci-and-pytest-integration.md (a real file, verified), cited three times with purpose statements ("deep CI wiring and advanced auth hooks live in...", "The full GitHub Actions workflow... and the per-PR / nightly / weekly cadence table live in..."). The reference is exactly one level deep with no nested references, matching anchor 5's clear overview with well-signaled one-level-deep references. | 5 / 5 |
Total | 18 / 20 Passed |