CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/flake-dashboard-author

Builds a persistent flakiness infrastructure dashboard from JUnit XML or JSON CI run history: defines the flake-rate metric (failures per test over a configurable window), authors the data model, generates a Grafana time-series panel JSON or configures a Datadog CI Visibility view, derives the quarantine-candidate query, and wires trend alerts. Use when a team needs a long-lived observability surface for test reliability that outlasts any single weekly report.

74

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

87%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-structured infrastructure skill with executable SQL, Grafana JSON, Datadog queries, and a worked bootstrap. Its main gap is the absence of an explicit validation checkpoint after the batch ingestion step, which prevents a top workflow-clarity score.

Suggestions

Add an explicit validation checkpoint after test-run ingestion — e.g., query the loaded row count or spot-check a known test before building dashboards and alerts — to close the validate→fix→retry loop for this batch database operation.

The commands reference scripts/parse_junit.py, scripts/ingest_playwright_json.js, scripts/quarantine_candidates.sql, and dashboards/flakiness-overview.json, but no scripts/ or assets/ bundle files exist; either provide these files or state explicitly that the reader must author them so the commands are runnable as written.

DimensionReasoningScore

Conciseness

Lean for a complex infrastructure skill: every section delivers concrete artifacts (SQL DDL, a Grafana panel JSON, Datadog queries, alert steps) and assumes Claude's competence without explaining what Grafana, SQL, or JUnit are. The brief terminology note is the only mild padding but does not drag it to the 'mostly efficient but could be tightened' level.

3 / 3

Actionability

Fully executable, copy-paste-ready guidance throughout — a CREATE TABLE schema, an xmllint ingestion pipeline, a complete Grafana panel JSON, Datadog Explorer/Monitor queries, and a worked bootstrap with curl — matching the 'fully executable code/commands' anchor.

3 / 3

Workflow Clarity

The six steps are clearly sequenced and the worked example ties them together, but the batch database-ingestion operation has no explicit validate→fix→retry checkpoint (e.g., verifying loaded row counts before building dashboards), which the guidelines say should cap batch-operation workflows at 2 rather than 3.

2 / 3

Progressive Disclosure

Content is organized into clear numbered sections with a dedicated References list, and all external pointers (Grafana/Datadog/Playwright docs) and sibling-skill references are clearly signaled and one level deep; with no bundle files to split into, the well-organized single-file structure meets the bar.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, third-person description that names concrete capabilities, includes an explicit 'Use when' trigger, and carves out a distinct niche. It is comprehensive without resorting to vague fluff or buzzwords.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'defines the flake-rate metric', 'authors the data model', 'generates a Grafana time-series panel JSON or configures a Datadog CI Visibility view', 'derives the quarantine-candidate query', and 'wires trend alerts' — matching the 'lists multiple specific concrete actions' anchor.

3 / 3

Completeness

Clearly answers both what (the enumerated build actions) and when via the explicit trigger 'Use when a team needs a long-lived observability surface for test reliability that outlasts any single weekly report.'

3 / 3

Trigger Term Quality

Uses natural practitioner terms a user would actually say — 'flakiness dashboard', 'JUnit XML or JSON CI run history', 'Grafana', 'Datadog CI Visibility', 'flake-rate', 'test reliability' — giving good coverage rather than jargon.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche — a persistent flakiness infrastructure dashboard — explicitly contrasted with a one-off weekly report, making it unlikely to trigger for the wrong skill.

3 / 3

Total

12

/

12

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

referenced_paths_exist

Referenced path issues: 3 missing

Warning

Total

14

/

16

Passed

Reviewed

Table of Contents