CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/error-budget-tests

Build error-budget gate tests - SLO + error-budget calculation per Google SRE workbook ("difference between target uptime and actual uptime"); burn-rate alerting; monthly-budget exhaustion test; freeze-trigger when budget consumed. Per sre.google embracing-risk reference. Includes the incident-metrics reference for MTTR / MTBF / MTTD / MTTA - per-incident record schema, calculation formulae, exclusion rules, dashboards-as-code, and target-vs-actual alerting. Use when an SLO and error budget are written down but nothing verifies that burn-rate alerts fire or that the release freeze engages when the budget runs out, or when MTTR / MTBF dashboards report numbers nobody can reproduce.

68

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable body that walks through eight concrete error-budget gate tests with executable Python and specific thresholds, plus useful anti-patterns and limitations. Minor gaps: undefined helper functions and an explicit validate-fix-retry loop would push it higher.

Suggestions

Define or stub the referenced helpers (compute_sli, burn_rate_alert, BudgetTracker, multi_window_alert, weekly_budget_report, release_gate) so the examples are end-to-end executable rather than relying on implied signatures.

Add an explicit validate->fix->retry note (e.g., 'on a failing test, fix the alert/budget logic and re-run the gate') to close the feedback-loop gap for the destructive/batch cap.

Consider extracting the Step 7 multi-window burn-rate table or the full incident-metrics schema into references/ so SKILL.md stays a tighter overview pointing to one-level-deep detail.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence, with each step anchored to executable Python rather than padding; a few illustrative Google SRE workbook quotes and the SLI/SLO table restate context Claude partly already knows, keeping it just shy of fully lean.

4 / 5

Actionability

Eight concrete Python test functions with specific assertions and real thresholds (14.4x, 6x, 1x burn rates) provide mostly executable guidance; helper symbols like compute_sli, burn_rate_alert, and BudgetTracker are referenced but not defined, leaving minor gaps.

4 / 5

Workflow Clarity

Steps 1-8 are clearly sequenced and each step's test assertion acts as its own validation checkpoint, with an Anti-patterns table and Limitations section for feedback; it lacks an explicit validate->fix->retry loop, but the read-only gate-test nature means the assertions are the checkpoints.

4 / 5

Progressive Disclosure

Well-organized sections (When to use, Steps 1-8, Anti-patterns, Limitations, References) with a single one-level-deep bundle reference ([references/mttr-mtbf.md]) that is clearly signaled and described inline; all eight steps are inlined in SKILL.md rather than split out, a minor organization gap.

4 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description that names concrete capabilities and pairs them with an explicit, scenario-based 'Use when' trigger clause. It clearly distinguishes the skill's SRE error-budget verification niche.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'SLO + error-budget calculation', 'burn-rate alerting', 'monthly-budget exhaustion test', 'freeze-trigger when budget consumed', and the MTTR/MTBF/MTTD/MTTA record schema, formulae, exclusion rules, and dashboards-as-code — giving comprehensive coverage of the skill's capabilities.

5 / 5

Completeness

Explicitly answers both 'what' (build error-budget gate tests verifying SLO/burn-rate/freeze/MTTR metrics) and 'when' with concrete trigger phrases: 'Use when an SLO and error budget are written down but nothing verifies that burn-rate alerts fire or that the release freeze engages...'.

5 / 5

Trigger Term Quality

Includes natural terms users would say — 'SLO', 'error budget', 'burn-rate', 'release freeze', 'MTTR / MTBF dashboards' — but is missing some common synonyms and file/extension variations, stopping short of the comprehensive anchor.

4 / 5

Distinctiveness Conflict Risk

Occupies a clear SRE niche — error-budget gate verification tests — with distinct triggers (SLO/error-budget/burn-rate/freeze) and minimal overlap risk with other skills.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents