CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

flaky-test-fixer

Use when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in dd-trace-js. Classifies infrastructure and deterministic failures before reproduction or code search.

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, action-oriented flaky-test workflow with strong validation gates, feedback loops, and a report checklist. Slightly dense prose and the absence of concrete commands keep it from being fully lean and copy-paste executable.

DimensionReasoningScore

Conciseness

Dense procedural prose that assumes Claude's competence and avoids explaining known concepts (no "what is a flaky test" padding), though several long sentences could be tightened, keeping it just below the lean 5 anchor.

4 / 5

Actionability

Concrete directives ("state a one-line candidate mechanism", search by "violated invariant and lifecycle owner", "Use fake timers instead of real-time waits", run "coverage and lint from AGENTS.md") give executable guidance with only minor gaps and no literal copy-paste commands.

4 / 5

Workflow Clarity

A clear classify-once gate flows into a 6-step fix sequence with explicit validation checkpoints ("Do not reproduce or search test code before this gate", "Do not design a fix before this sentence holds", "Verify the original failure without the fix") and a 5-item report checklist, satisfying the feedback-loop requirement for batch cohort fixes.

5 / 5

Progressive Disclosure

Well-organized single-file structure with clear sections (Classify once, Investigate and fix, Hung jobs, Parallel investigation, Report) and one inline one-level external reference (AGENTS.md); no bundle files exist to split, but the body exceeds the under-50-line simple-skill exception, so it stops short of 5.

4 / 5

Total

17

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, trigger-rich description scoped to a clear niche with explicit use-when guidance and proper third-person voice. Minor room remains to enumerate the action set more comprehensively and further reduce overlap with general debugging skills.

DimensionReasoningScore

Specificity

Lists concrete actions ("classifying, investigating, or fixing") plus a secondary specific clause ("Classifies infrastructure and deterministic failures before reproduction or code search"), but the action set is umbrella rather than comprehensively enumerated, so it sits below the 5 anchor.

4 / 5

Completeness

An explicit "Use when..." clause with concrete triggers answers when, and "classifying, investigating, or fixing a suspected flaky test" answers what, both stated clearly in third person.

5 / 5

Trigger Term Quality

Comprehensive natural trigger terms with synonyms — "flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency" — exactly the phrases a user or CI reporter would say.

5 / 5

Distinctiveness Conflict Risk

The niche is clear and explicitly scoped to dd-trace-js flaky tests with distinct triggers, leaving only minor overlap risk against general test-debugging or CI-fixing skills rather than the minimal-conflict 5 anchor.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

DataDog/dd-trace-js

Path

.agents/skills/flaky-test-fixer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.