CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/openapi-contract-diff

Diffs two OpenAPI versions for breaking changes (removed endpoints, deleted schemas, narrowed enums, response shape changes) using `oasdiff breaking`, severity-classifies the findings (ERR / WARN / INFO), and gates CI with `--fail-on`. Use when reviewing an OpenAPI spec change in a PR or on a release tag.

75

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-structured skill body built around executable commands and a complete CI example. The only weakness is mild promotional redundancy in the overview that lightly dilutes token efficiency.

Suggestions

Remove the duplicate 'over 250 checks' / '250+ checks' claim — state the rule-set size once, or drop the count entirely since it is version-sensitive and may go stale.

Trim the promotional framing in the Overview ('canonical CLI') to a factual one-line orientation so the body leads with the actionable setup.

Consider collapsing the four near-identical --format example blocks into a single line listing the formats, keeping only the JSON and text variants as worked examples.

DimensionReasoningScore

Conciseness

Mostly lean and code-forward, but the promotional framing ('canonical CLI', 'runs over 250 checks') is stated twice (Overview and 'What counts as breaking') and could be tightened without losing utility.

2 / 3

Actionability

Provides fully executable, copy-paste-ready guidance: install commands, run commands, multiple --format examples, the Docker variant, --fail-on gating, a jq triage pipeline, and a complete GitHub Actions workflow.

3 / 3

Workflow Clarity

The CI integration is clearly sequenced (extract base spec via merge-base, run oasdiff, upload report) with the fetch-depth: 0 gotcha explained and the exit code serving as the explicit gate/validation signal.

3 / 3

Progressive Disclosure

Well-organized into clearly labeled sections with one-level-deep external URL references and no nested reference chains; no bundle files are needed for a skill of this scope.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A tight, third-person description that states concrete capabilities, an explicit use-when trigger, and a clear niche distinct from sibling contract-testing skills. No vague fluff or over-claims.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Diffs two OpenAPI versions for breaking changes', 'severity-classifies the findings (ERR / WARN / INFO)', and 'gates CI with --fail-on' — plus enumerated breaking patterns (removed endpoints, deleted schemas, narrowed enums, response shape changes).

3 / 3

Completeness

Clearly answers both 'what' (diffs, severity-classifies, gates CI) and 'when' via the explicit 'Use when reviewing an OpenAPI spec change in a PR or on a release tag' clause, satisfying the completeness bar.

3 / 3

Trigger Term Quality

Includes natural terms a user would say when needing this skill — 'OpenAPI spec change', 'breaking changes', 'PR', and 'release tag' — with good domain coverage rather than abstract jargon.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche (OpenAPI breaking-change diffing) with distinct triggers and is explicitly contrasted against pact-contract-testing, making it unlikely to fire for the wrong skill.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents