CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

fix-tests

Use this skill to reproduce and fix flaky and disabled tests.

Quality

74%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.agents/skills/fix-tests/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is a strong, highly actionable workflow document: concrete toolchain commands, an explicitly sequenced multi-agent process with decision points, validation checkpoints, and a fix-verify-retry feedback loop. Weaknesses are minor — a few unspecified placeholder values, small redundancies, and typographical slips ('Iff', "doesn't reproduced", 'that is being testing').

DimensionReasoningScore

Conciseness

The body is dense, operational, and assumes Claude's competence — it never explains what flaky tests or CI bots are. Minor trimming is possible (repeated upload/verify instructions between the fix-test and Results sections, and phrases like 'initially attempt' and 'let's say'), so it sits just below the 'every token earns its place' anchor of 5.

4 / 5

Actionability

It provides concrete, largely copy-paste-ready commands: './dt test --repeat=<count> path/to/foo.test.ts:exact_test_id', the full 'git cl try -B devtools-frontend/try -b e2e_stressor_linux ...' invocation, 'git cl try-results --issue=...', and 'git cl upload -f', plus a results table format. Minor gaps keep it at 4: no concrete value for the local '--repeat=<count>' (the 4-minute duration mapping is unspecified) and no explanation of where the patchset number comes from.

4 / 5

Workflow Clarity

The multi-step process is explicitly sequenced (two simultaneous repro agents, a monitored decision point with a user question, a gated fix agent) with explicit validation checkpoints ('Make sure that at least one test ran to completion on the bot', 'Always verify, by running the tests again') and a genuine feedback loop ('If the test fails again with the same error... a new fix must be implemented (repeat the verification cycle)'). The risky batch operations (CL upload, bot runs) all have their required validation, so no cap applies.

5 / 5

Progressive Disclosure

No bundle files exist, and the ~90-line single file is well organized into clear sections (Reproduction agents, Local reproduction, Bot reproduction, Next steps, Fixing, Results) with an appropriately signaled external reference to the 'devtools-version-control' skill. It exceeds the 50-line simple-skill threshold and could arguably split the bot-specific details out, so it fits 'good structure; minor organization gaps' at 4 rather than 5.

4 / 5

Total

17

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is clear, in third person, and names a distinct niche, but it is minimal: only two concrete actions, no 'Use when...' trigger clause, and no synonyms a user might naturally say. It answers 'what' well while leaving 'when' only weakly implied.

Suggestions

Add an explicit trigger clause, e.g., 'Use when a test is flaky, intermittently failing, skipped, or disabled, or when the user asks to deflake or stabilize a test.'

List a few more concrete capabilities to raise specificity, e.g., 'reproduce flakiness via local repeated runs and stressor bot try jobs, then upload and verify a fix changelist'.

Include natural synonyms users would actually say — 'intermittent failures', 'unstable tests', 'deflake', 'skipped tests' — to improve trigger term coverage.

DimensionReasoningScore

Specificity

The description names its domain ("flaky and disabled tests") and exactly two concrete actions ("reproduce and fix"), matching the anchor for 1-2 concrete actions. It does not list the several specific actions needed for a 4 (e.g., local repeated runs, stressor bot try jobs, uploading deflake changelists).

3 / 5

Completeness

It clearly answers 'what' ("reproduce and fix flaky and disabled tests") but has no 'Use when...' clause; the 'when' is only weakly implied by "Use this skill to". Per the judging guideline, a missing explicit trigger clause caps completeness at 3.

3 / 5

Trigger Term Quality

"flaky" and "disabled tests" are natural terms a user would say, but common variations and synonyms are missing ("intermittent failures", "deflake", "skipped tests", "unstable tests"). This fits 'some relevant keywords but missing common variations' better than the good-coverage anchor at 4.

3 / 5

Distinctiveness Conflict Risk

"reproduce and fix flaky and disabled tests" carves out a fairly distinct niche (flaky-test triage and deflaking) with minimal conflict risk against unrelated skills. It falls short of 5 only because it could overlap with a generic 'fix failing tests' skill since it lacks more distinctive trigger phrases like 'deflake' or 'stressor bots'.

4 / 5

Total

13

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

ChromeDevTools/devtools-frontend

Path

.agents/skills/fix-tests/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.