CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/release-runbook-author

Use when a service is about to ship and its release steps live only in people's heads or a chat thread, or a shared release window needs its cutover order. Writes a six-phase runbook (pre-flight, smoke, canary, promote gate, rollout, verification) with baseline-relative criteria and rollback paths.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An unusually well-structured procedural skill: the six-phase workflow is clearly sequenced with explicit validation gates, feedback loops, and a defect checklist, and the bundle is cleanly split across one-level-deep, well-signaled reference files. The one real weakness is token efficiency — quoted definitions of concepts Claude already knows and a heavily repeated citation add length without adding guidance.

Suggestions

Replace the block-quoted definitions of well-known concepts (the canary definition, the control/canary split, the three-recovery taxonomy) with bare citations or one-clause paraphrases — Claude already knows what a canary is and only needs the source for attribution.

Cite the Azure Well-Architected safe-deployments page once (e.g., in a short Sources section) instead of repeating the same URL roughly seven times throughout the phases.

Trim rhetorical framing sentences such as 'the difference between a gate and a formality' and 'the failure mode it addresses is...' where the adjacent rule already carries the point.

DimensionReasoningScore

Conciseness

The core content is non-obvious operational judgment (two-condition thresholds, window honesty, gate integrity), but the body block-quotes definitions Claude already knows — the canary definition from Fowler and the control/canary split from the SRE Workbook — and repeats the same Azure Well-Architected URL roughly seven times. This is more than the minor trimming of the 4 anchor but the document is not dominated by padding as the 2 anchor would require.

3 / 5

Actionability

Guidance is fully concrete: literal threshold examples ("5xx rate at or below 0.5 percent", "1.5 times baseline"), a filled-in canary observation table that serves as a copy-paste-ready format, a promote-gate decision table with written consequences per option, a pre-flight table naming the evidence to record, and a final defect checklist. As an instruction-only skill, its guidance is executable without code and covers the common cases.

5 / 5

Workflow Clarity

Six phases are numbered, ordered, and cross-referenced in a comparison table; each phase states its pass criterion and output. Feedback loops are explicit ("A failed pre-flight row ends the release at phase 1"; a rollout threshold trip "halts the expansion and returns to phase 4's decision table"), and the process closes with a checklist — matching the 5 anchor's validation, error-recovery, and checklist requirements exactly.

5 / 5

Progressive Disclosure

The six-phase core procedure lives inline in SKILL.md while the worked example, output template, anti-patterns, and the sibling cutover procedure are split into seven real reference files, each introduced in a dedicated section with a one-line description of its contents. All references are one level deep (verified: no reference file links to another), matching the 5 anchor's clear overview with well-signaled references.

5 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit trigger guidance with vivid, natural conditions and a concrete, enumerated statement of the output artifact. Its only weaknesses are a few missing common synonyms (deploy, go-live) and a trigger clause that invites the closely related cutover-sequencing use case the skill itself does not own.

DimensionReasoningScore

Specificity

Concrete and comprehensive for a single-procedure skill: "Writes a six-phase runbook (pre-flight, smoke, canary, promote gate, rollout, verification) with baseline-relative criteria and rollback paths" enumerates the phases by name plus the criteria convention and rollback coverage, all in third person. No coverage gaps that would drop it to the 4 anchor.

5 / 5

Completeness

Both halves are explicit and concrete: an explicit "Use when..." clause with specific trigger scenarios, and a clear statement of what the skill produces (a six-phase runbook with baseline-relative criteria and rollback paths). This matches the 5 anchor; the 4 anchor requires a 'when' that is less explicit, which does not apply here.

5 / 5

Trigger Term Quality

Natural phrases a user would say are present ("a service is about to ship", "release steps live only in people's heads or a chat thread", "shared release window", "cutover order"), but common synonyms like "deploy"/"deployment" and "go-live" are missing. Good coverage with a few natural terms missing fits the 4 anchor, not the comprehensive synonym coverage of 5.

4 / 5

Distinctiveness Conflict Risk

The single-service release runbook niche is clear and distinguishable, but the trigger "or a shared release window needs its cutover order" describes a cross-team sequencing problem that the body explicitly disclaims and routes to a separate procedure (cutover-sequence.md). That is minor overlap risk with a closely related sibling skill, fitting the 4 anchor rather than the minimal-conflict 5 anchor.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page