CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/error-budget-tests

Build error-budget gate tests - SLO + error-budget calculation per Google SRE workbook ("difference between target uptime and actual uptime"); burn-rate alerting; monthly-budget exhaustion test; freeze-trigger when budget consumed. Per sre.google embracing-risk reference. Includes the incident-metrics reference for MTTR / MTBF / MTTD / MTTA - per-incident record schema, calculation formulae, exclusion rules, dashboards-as-code, and target-vs-actual alerting. Use when an SLO and error budget are written down but nothing verifies that burn-rate alerts fire or that the release freeze engages when the budget runs out, or when MTTR / MTBF dashboards report numbers nobody can reproduce.

68

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, test-driven guide: eight sequenced steps each anchored by concrete code with exact SRE-workbook thresholds, an anti-patterns table tying common failures to fixes, and an honest Limitations section. The incident-metrics material is properly offloaded to a real one-level-deep reference. Main gaps are the undefined helper scaffolding (inherent to testing user-owned infrastructure but not explicitly justified) and the absence of an explicit run/verify feedback loop for the test suite.

DimensionReasoningScore

Conciseness

Mostly lean: each step is a compact table or code block with minimal prose ('Maintenance windows + planned outages: agreed-upon exclusions matter. Test the rule.'). However, repeated provenance quotations ('Per [Google SRE - Embracing Risk]: "A failure affecting 0.0002% of queries consumes 20% of a 0.001% quarterly budget."') and the opening epigraph could be trimmed — minor over-explanation, so not 5; well above 3 since no section teaches concepts Claude already knows.

4 / 5

Actionability

Eight concrete test examples with exact thresholds and expected values ('monthly_budget_min = 30 * 24 * 60 * 0.001 # 43.2 min', 'error_rate_in_window = 0.0144'), plus precise burn-rate window tables. Not 5: helpers like BudgetTracker(...), burn_rate_alert(...), and compute_sli(...) are undefined templates depending on the user's infrastructure, so the code is not copy-paste executable; not 3 because the code is real, syntactically valid test syntax with precise assertions rather than pseudocode.

4 / 5

Workflow Clarity

Steps 1-8 form a clear, logical build sequence (define SLI/SLO → test SLI calculation → budget consumption → burn-rate alerting → freeze trigger → window reset → multi-window → reporting), each with concrete pass criteria, and the Anti-patterns table maps failures back to fix steps ('Single burn-rate alert | Either too noisy or too late | Step 7 multi-window'). Not 5: there is no explicit run-the-suite/verify loop or error-recovery checkpoint (e.g., what to do when a gate test fails in CI), and Step 4's 'Test both directions' is the only negative-case instruction.

4 / 5

Progressive Disclosure

Appropriately split: the core error-budget test workflow lives in SKILL.md, while the distinct incident-metrics material (schema, formulae, dashboards) is correctly factored into a real, one-level-deep bundle file, clearly signaled as '[references/mttr-mtbf.md](references/mttr-mtbf.md) - incident metrics that consume budget: MTTR / MTBF / MTTD / MTTA schema, formulae, and dashboards-as-code'. Sections are well-organized with headers, tables, and code; no buried or nested references. Verified the referenced file exists in the bundle.

5 / 5

Total

17

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete, comprehensive capability listing paired with an explicit and well-phrased 'Use when...' trigger clause covering both the error-budget and incident-metrics halves of the skill. It uses third person and stays dense rather than padded, though the parenthetical SRE-workbook quotation and provenance note add length without adding trigger value, and a few common synonyms (SLA, uptime, reliability) are absent.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Build error-budget gate tests', 'burn-rate alerting; monthly-budget exhaustion test; freeze-trigger when budget consumed', 'per-incident record schema, calculation formulae, exclusion rules, dashboards-as-code, and target-vs-actual alerting' — comprehensively covering the skill's domain. Not 4: the action list has no material coverage gaps.

5 / 5

Completeness

Explicitly answers both: what ('Build error-budget gate tests - SLO + error-budget calculation ... freeze-trigger when budget consumed') and when ('Use when an SLO and error budget are written down but nothing verifies that burn-rate alerts fire or that the release freeze engages ... or when MTTR / MTBF dashboards report numbers nobody can reproduce'). Both are concrete and explicit with trigger phrases.

5 / 5

Trigger Term Quality

Natural SRE vocabulary users would say — 'SLO', 'error budget', 'burn-rate alerts', 'release freeze', 'MTTR / MTBF dashboards' — with an explicit trigger scenario clause. Not 5: common synonyms like 'service level objective', 'SLA', 'uptime target', and 'reliability' are missing; clearly above 3 because the terms present are the ones practitioners actually use.

4 / 5

Distinctiveness Conflict Risk

'error-budget gate tests' with burn-rate/freeze triggers is a clear niche with minimal conflict risk, but the second half ('Includes the incident-metrics reference for MTTR / MTBF / MTTD / MTTA ... dashboards-as-code') broadens scope into territory a standalone incident-metrics skill would own — minor overlap risk with closely related skills, so not 5.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents