CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/error-budget-tests

Use when an SLO and error budget exist but nothing proves burn-rate alerts fire or the release freeze engages when the budget runs out, or MTTR and MTBF numbers can't be reproduced. Tests error-budget math, burn-rate alerts, exhaustion and freeze triggers, and incident metric calculations.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-constructed testing skill: eight clearly sequenced steps, each backed by concrete test code with correct domain-specific thresholds, plus a useful anti-patterns table and honest limitations. The main gaps are trimmable SRE-book quotations, test code that depends on undefined helpers, and the MTTR/MTBF reference being relegated to a footer rather than wired into the workflow.

Suggestions

Trim or compress the Google SRE quotation blocks (Steps 5 and 8 in particular) to one-line citations, since Claude already knows the underlying concepts; keep only the numbers that drive test thresholds.

Link references/mttr-mtbf.md from the workflow itself (e.g., a short Step or note after Step 8 such as 'For incident-metric tests (MTTR/MTBF/MTTD/MTTA), see references/mttr-mtbf.md'), since the description promises incident metric calculations but no step points there.

Add a brief note on wiring the tests to the real implementation (imports or stubs for burn_rate_alert, BudgetTracker, release_gate, multi_window_alert) so the examples are runnable against the user's actual alerting/gating code.

DimensionReasoningScore

Conciseness

The body is mostly lean (tables, tight test code, minimal prose), but three to four SRE-book quote blocks re-explain concepts Claude already knows (e.g., "releases are temporarily halted", "Rather than political negotiations, teams reference objective metrics"), which are minor over-explanation that could be trimmed. Not a 3 because the padding is brief and each quote grounds a specific test design decision.

4 / 5

Actionability

Concrete pytest-style tests with exact domain thresholds (14.4x burn, 6x, 43.2-minute budget) and real assertions — clearly not pseudocode — but they call helpers that are never defined or imported (burn_rate_alert, BudgetTracker, release_gate, multi_window_alert), so they are not copy-paste executable. Fits 'mostly executable with minor gaps' rather than the fully-executable anchor.

4 / 5

Workflow Clarity

Steps 1-8 are clearly sequenced with each step producing a test, and "Test both directions: burn at 14.4x → critical; below threshold → no alert" adds a checkpoint. It falls short of the 5 anchor because there is no explicit validate-fix-retry feedback loop (e.g., run tests against the real implementation and what to do on failure).

4 / 5

Progressive Disclosure

The single bundle file references/mttr-mtbf.md exists, is one level deep, and is clearly described with its contents; however, it is only surfaced in the end References section while the description promises "incident metric calculations" with no in-flow step pointing to it. Good structure with a minor organization gap, not the well-signaled-navigation anchor above.

4 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it pairs an explicit, concrete "Use when" clause covering three real trigger scenarios with a clear third-person inventory of what it tests. Keyword coverage is solid, missing only a few natural synonyms.

DimensionReasoningScore

Specificity

"Tests error-budget math, burn-rate alerts, exhaustion and freeze triggers, and incident metric calculations" lists multiple concrete actions covering the domain comprehensively, matching the comprehensive-coverage anchor rather than the minor-gaps anchor below it.

5 / 5

Completeness

An explicit "Use when an SLO and error budget exist but nothing proves burn-rate alerts fire or the release freeze engages... or MTTR and MTBF numbers can't be reproduced" gives concrete trigger conditions, and the third-person "Tests..." sentence clearly states what it does.

5 / 5

Trigger Term Quality

Natural SRE terms are present ("SLO", "error budget", "burn-rate", "release freeze", "MTTR", "MTBF"), but common synonyms like "service level objective", "SRE", or "reliability target" are missing, so it fits good-but-not-comprehensive keyword coverage.

4 / 5

Distinctiveness Conflict Risk

The niche (testing that error-budget enforcement actually fires) is distinct with trigger terms unlikely to appear when other skills are needed, so conflict risk is minimal.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page