CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/openapi-contract-diff

Use for any question about whether an OpenAPI or Swagger spec change breaks clients, including one pasted diff and a partner integration that broke: removed endpoints, deleted schemas, narrowed enums, changed responses. Runs oasdiff breaking, grades findings ERR, WARN or INFO and gates CI with --fail-on.

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality, tool-specific skill body: fully executable commands cover local, Docker, remote, and CI usage, with genuinely non-obvious details (merge-base extraction, x-extensible-enum, level-to-severity mapping). It is efficient but not perfectly lean, and workflow sequencing plus file organization could be slightly more explicit.

DimensionReasoningScore

Conciseness

The body is dense and operational (severity table, install, format flags, fail-on semantics, jq triage, CI YAML) with no explanation of concepts Claude already knows, but a few tokens could be trimmed — e.g., repeated attribution lines like "(Per [oasdiff-readme][readme])" and the slightly conversational Authoring section — so it is efficient rather than lean.

4 / 5

Actionability

Fully executable, copy-paste-ready guidance throughout: go install / docker pull commands, every --format variant, --fail-on gate examples, a jq triage one-liner, and a complete GitHub Actions workflow including the non-obvious fetch-depth: 0 merge-base step — covering local, remote-URL, Docker, and CI cases.

5 / 5

Workflow Clarity

Sections follow a clear logical sequence (Install → Running → Reading the report → CI integration) and the CI workflow is stepwise with the exit-code gate as a checkpoint, but there is no explicit end-to-end numbered sequence or validate/recover feedback loop, so checkpoints are implicit rather than explicit.

4 / 5

Progressive Disclosure

Well-sectioned body with clearly labeled external references (each linked oasdiff doc is annotated with what it covers), though no bundle files exist and content that could live in a reference file — the ~35-line CI workflow YAML and the detailed report-format examples — is inlined, leaving minor organization gaps.

4 / 5

Total

17

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concise, with an explicit 'Use for...' trigger clause, concrete capability verbs, and a clearly delineated OpenAPI/Swagger breaking-change niche. Keyword coverage is good but misses a few natural synonyms and file extensions, and the broad 'any question' framing leaves minor overlap risk with sibling contract-testing skills.

DimensionReasoningScore

Specificity

"Runs oasdiff breaking, grades findings ERR, WARN or INFO and gates CI with --fail-on" lists multiple concrete actions, and the enumerated finding types ("removed endpoints, deleted schemas, narrowed enums, changed responses") give comprehensive in-domain coverage — beyond the 'minor gaps' of a 4.

5 / 5

Completeness

Explicitly answers both: 'what' ("Runs oasdiff breaking, grades findings ERR, WARN or INFO and gates CI with --fail-on") and 'when' via an explicit "Use for any question about whether an OpenAPI or Swagger spec change breaks clients, including one pasted diff and a partner integration that broke" with concrete trigger phrases.

5 / 5

Trigger Term Quality

Good natural-term coverage ("OpenAPI", "Swagger spec change", "breaks clients", "diff", "partner integration that broke", "CI") with both OpenAPI and Swagger synonyms, but common variations like "breaking change" itself, "backward compatibility", and file extensions (.yaml) are missing — short of the comprehensive synonym/extension coverage of a 5.

4 / 5

Distinctiveness Conflict Risk

Clear niche — spec-driven breaking-change gating, with the tool named — but "any question about whether an OpenAPI or Swagger spec change breaks clients" is broad and overlaps closely related contract-testing skills (e.g., a Pact consumer-driven counterpart), so minor overlap risk remains rather than minimal.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page