CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

protobuf-compat-checking

Use when a pull request changes .proto files for gRPC services, Buf Schema Registry modules or message-bus payloads, and consumers must not break. Runs buf breaking against a past version, picks the FILE, PACKAGE, WIRE_JSON or WIRE category, sets exemptions and gates CI.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/protobuf-compat-checking

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, highly actionable body: nearly everything is executable commands or precise configuration, and the buf-specific knowledge (categories, v2 config, baselines, CI wiring) is exactly what Claude would not already know. The main improvements are trimming small redundancies and moving the CI workflow details to a reference file to slim the main skill.

DimensionReasoningScore

Conciseness

The body is dense with non-obvious, buf-specific material (the four-category table, v2 buf.yaml shape, .git# baseline syntax, fetch-depth: 0 requirement) and assumes competence rather than teaching Protobuf basics. It is not 5 because of small pads: the citation-only line "(Per [buf-breaking][breaking].)", the counterpart skills listed in both Overview and References, and the explanation of the v1alpha1/v1beta1 package convention Claude already knows.

4 / 5

Actionability

Every section is copy-paste executable: three concrete baseline invocations (git ref, BSR module, tarball/image), a complete buf.yaml block, a full GitHub Actions workflow, a tag-based release script, and a jq triage pipeline with --error-format json. Specific examples cover the common PR-vs-main and tag-vs-production cases, matching the 5 anchor; it is clearly above the 4 anchor's 'minor gaps'.

5 / 5

Workflow Clarity

The sections form a coherent sequence (pick category -> configure buf.yaml -> choose baseline -> run -> read report -> gate CI) with explicit decision guidance ("Choose FILE for new internal services ... choose WIRE only when JSON encoding is out-of-scope") and an interpretation checkpoint (non-zero exit means breakage detected). It is not 5 because there is no explicitly numbered end-to-end flow or error-recovery loop; not 3 because the sequence and decision points are present and clearly written, not merely implicit.

4 / 5

Progressive Disclosure

No bundle files exist (references/, scripts/, assets/ are all absent), and the body is well-organized with clear headers, deferring detail to one-level-deep, clearly signaled external docs (buf-breaking, buf-yaml) instead of duplicating them. It is not 5 because at ~220 lines some self-contained chunks (the full GitHub Actions YAML, the tag-based release recipe) would fit better in a reference file, and the References section repeats the counterpart-skill list already given in the Overview.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states a specific, multi-action what using the exact tool and category names, and an explicit when-clause with concrete file-type and scenario triggers. The only notable gap is that the word "protobuf" itself (and common synonyms like "backward compatibility") never appears, which slightly weakens natural-term coverage.

DimensionReasoningScore

Specificity

"Runs buf breaking against a past version, picks the FILE, PACKAGE, WIRE_JSON or WIRE category, sets exemptions and gates CI" lists multiple specific concrete actions naming the exact tool and exact category enums, comprehensively covering the skill's capabilities. It is not a 4 because the only uncovered area (report triage) is a minor gap, not the 'minor gaps in coverage' of a partial action list.

5 / 5

Completeness

Explicitly answers when ("Use when a pull request changes .proto files for gRPC services, Buf Schema Registry modules or message-bus payloads, and consumers must not break") with concrete trigger phrases, and what ("Runs buf breaking against a past version, picks the ... category, sets exemptions and gates CI"). Not a 4 because the when-clause is already explicit and specific, the very thing the 4 anchor says could be improved.

5 / 5

Trigger Term Quality

".proto files", "gRPC services", "Buf Schema Registry", "message-bus payloads", "pull request", and "break" are natural terms a user would say, giving good coverage. It falls short of 5 because the standalone word "protobuf" and common phrasings like "backward compatibility" / "breaking change" are missing.

4 / 5

Distinctiveness Conflict Risk

The triggers are file-type- and tool-specific (.proto, gRPC, Buf Schema Registry, buf breaking), creating a clear niche with minimal conflict risk against sibling skills like REST or GraphQL contract-diff checkers, which trigger on different file types. It fits the 5 anchor ('clear niche with distinct triggers') better than the 4 anchor's 'minor overlap risk with closely related skills'.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

testland/qa

Path

plugins/qa-contract-testing/skills/protobuf-compat-checking/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.