CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/openapi-contract-diff

Use when a pull request or release changes an OpenAPI spec and breaking changes must be caught: removed endpoints, deleted schemas, narrowed enums, changed responses. Runs oasdiff breaking, grades findings ERR, WARN or INFO and gates CI with --fail-on.

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

90%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a strong, action-first reference: complete executable commands, a copy-paste-ready CI workflow, and clear interpretation guidance for both text and JSON output. Its main weaknesses are mild citation padding and a monolithic structure that could offload the CI workflow and full breaking-change catalog to reference files.

DimensionReasoningScore

Conciseness

The body is efficient and assumes Claude's competence — it never explains what OpenAPI or CI is, and every section carries operational content. Minor trimmable padding exists: repeated "(Per [oasdiff-readme][readme])" citation parentheticals and the "Available formats" line that re-lists formats already demonstrated in the code block. This is anchor 4 (efficient, minor over-explanation), not anchor 5 where every token earns its place.

4 / 5

Actionability

Fully executable, copy-paste-ready guidance: install commands (go install, docker pull), every --format invocation, the docker run variant, --fail-on flag lines, a jq triage one-liner, and a complete GitHub Actions workflow covering the common CI case. Only the remote-spec example uses placeholder URLs, which is an edge case rather than a gap in the common cases.

5 / 5

Workflow Clarity

A coherent progression (Install → Running → Reading the report → CI integration) with the exit-code gate as an explicit checkpoint and clear --fail-on tier semantics, plus a remediation hint (x-extensible-enum). It falls short of anchor 5 because the sequence is implicit in section order rather than explicitly enumerated, and there is no validate-and-retry feedback loop. As a read-only review tool it involves no destructive or batch operations, so the workflow cap at 3 does not apply.

4 / 5

Progressive Disclosure

Well-organized sections with easy navigation, and all references (oasdiff GitHub docs) are one level deep and clearly signaled via a References section and inline link definitions. However, the ~230-line body is a monolith with no bundle split — the full CI workflow YAML and the breaking-change catalog are candidates for a references/ file — which places it at anchor 4 rather than anchor 5's appropriately split content.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concise, with an explicit "Use when" trigger clause, concrete enumerated breaking-change categories, and specific tool actions including the CI gate flag. The only weakness is keyword coverage missing common synonyms such as "Swagger" or "spec diff".

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "Runs oasdiff breaking, grades findings ERR, WARN or INFO and gates CI with --fail-on" — and enumerates the concrete finding categories ("removed endpoints, deleted schemas, narrowed enums, changed responses"), with no gaps in coverage of what the skill does. Third-person voice is used throughout, so no voice penalty applies.

5 / 5

Completeness

Explicitly answers both questions: "Use when a pull request or release changes an OpenAPI spec and breaking changes must be caught" is a concrete when-clause, and the run/grade/gate actions are an explicit what. This matches the anchor-5 example structure (what + "Use when" with concrete trigger phrases), not anchor 4 where the when is only loosely specified.

5 / 5

Trigger Term Quality

Good natural keyword coverage ("pull request", "OpenAPI spec", "breaking changes", "removed endpoints", "changed responses", "CI") that users would plausibly say, but common synonyms and variations are missing — notably "Swagger", "API contract", "spec diff", and file extensions like openapi.yaml. This sits above anchor 3 (only some relevant keywords) but below anchor 5 (comprehensive including synonyms and extensions).

4 / 5

Distinctiveness Conflict Risk

The named tool (oasdiff), OpenAPI-spec scope, and CI-gating trigger give it a clear niche with distinct triggers and minimal conflict risk against generic contract- or API-testing skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page