validating-api-contracts

This skill validates API contracts using consumer-driven testing and OpenAPI validation. It leverages Pact for consumer-driven contract testing, ensuring that API providers adhere to the expectations of their consumers. It also validates APIs against OpenAPI specifications to guarantee compliance and identify breaking changes. Use this skill when the user asks to generate contract tests, validate API responses, check backward compatibility, or validate requests/responses using the terms "contract-test", "ct", "Pact", "OpenAPI validation", or "consumer-driven contract testing".

0.94x

Quality

53%

Does it follow best practices?

Impact

90%

0.94x

Average score across 3 eval scenarios

Securityby

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./backups/skills-migration-20251108-070147/plugins/testing/contract-test-validator/skills/contract-test-validator/SKILL.md

Evaluation results

100%

Setting Up Contract Tests for a Mobile App and User Profile Service

Pact consumer-driven contract test generation

Criteria

Without context

With context

Pact library used

100%

Consumer contract generated

100%

Provider verification test created

100%

Consumer role identified

100%

Provider role identified

100%

Request interaction defined

100%

Response expectations defined

100%

API details specific

100%

Runnable test code

100%

Both sides documented

100%

81%

-13%

Validating API Responses Against an OpenAPI Specification

OpenAPI specification validation and discrepancy reporting

Criteria

Without context

With context

OpenAPI validator used

58%

Spec loaded correctly

100%

Discrepancies identified

100%

Violations reported

91%

100%

Specific endpoints checked

100%

Response body validated

100%

Validation report file produced

100%

No false positives on valid responses

100%

36%

Up-to-date spec used

100%

90%

-1%

Checking API Compatibility Before a New Release

API backward compatibility and breaking change detection

Criteria

Without context

With context

Breaking changes identified

100%

Non-breaking changes distinguished

83%

100%

Backward compatibility check tool/approach

100%

83%

Specific violations reported

100%

CI/CD integration shown

70%

60%

Exit code or pass/fail signal

100%

Both specs compared

100%

Report file produced

100%

Consumer impact described

55%

Repository: jeremylongshore/claude-code-plugins-plus-skills
Commit: 13d35b8

Evaluated: 2 months ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Setting Up Contract Tests for a Mobile App and User Profile Service Validating API Responses Against an OpenAPI Specification Checking API Compatibility Before a New Release

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.