CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ci-flaky-patrol

Classify a bounded batch of stale PR CI failures and choose the safest response.

Quality

75%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

High

Do not use without reviewing

Fix and improve this skill with Tessl

tessl review fix ./.qwen/skills/ci-flaky-patrol/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

83%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an exemplar of lean, highly actionable instruction writing: exact I/O contracts, a complete output schema, and unambiguous decision rules. Its main gaps are the absence of an explicit output-validation checkpoint for a batch operation and the lack of section headers for navigation.

Suggestions

Add an explicit validation step before writing, e.g. 'Before writing, verify every candidate has exactly one decision, identity fields match the input verbatim, and the JSON is valid.'

Add short section headers (Input, Actions, Flaky tests, Output, Constraints) to make the body scannable without adding tokens.

State what to do on malformed or partially unreadable input candidates (e.g. skip with no_action) to close the batch error-recovery loop.

DimensionReasoningScore

Conciseness

The body is dense with operational instructions — exact filenames, action definitions, length limits, tool restrictions — with no explanation of concepts Claude already knows and no padding. Every sentence carries a rule, matching 'Lean and efficient; every token earns its place'.

5 / 5

Actionability

It specifies the exact input file (`ci-flaky-input.json`), exact output file (`ci-flaky-decisions.json`), a complete copy-paste-ready JSON example, concrete classification criteria per action, verbatim field rules, 200-character limits, and a tool allowlist. This matches 'Fully executable; copy-paste ready code or commands; specific examples cover the common cases'.

5 / 5

Workflow Clarity

The sequence (read input → classify each candidate → write one decision per candidate) is clear and rules are well-defined, but this is a batch operation with no explicit validate-before-write or verify-coverage checkpoint — validation is delegated to the driver rather than performed as a step. Per the guideline capping batch workflows without validation steps at 3, it cannot score higher despite the coherent flow.

3 / 5

Progressive Disclosure

At ~47 lines with no bundle files, the content is appropriately self-contained and nothing belongs in a separate file, but the body uses no section headers, leaving minor organization gaps — 'Good structure; most content is appropriately placed; minor organization gaps' rather than the well-signaled-sections ideal.

4 / 5

Total

17

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description states a clear, specific purpose but omits any trigger guidance ('Use when...') and lacks the natural vocabulary (flaky, retry, red CI) a user would most likely say. It is distinguishable from generic skills but undersells its trigger surface.

Suggestions

Add an explicit trigger clause, e.g. 'Use when triaging stale or failed PR CI runs, flaky tests, or when the user asks to retry/rerun failed checks.'

Include natural synonyms users would say — 'flaky tests', 'retry failed CI', 'red builds' — to improve trigger term coverage.

Enumerate the concrete outcomes (rerun, comment, or no_action) so the capability set is explicit rather than summarized as 'safest response'.

DimensionReasoningScore

Specificity

"Classify a bounded batch of stale PR CI failures and choose the safest response" names the domain clearly and gives two actions ("Classify", "choose the safest response"), matching the anchor 'Names domain and 1-2 concrete actions, but not comprehensive'. It is not a 4 because the concrete response options (rerun/comment/no_action) are not enumerated and 'choose the safest response' is somewhat abstract.

3 / 5

Completeness

The 'what' is clearly stated (classify stale PR CI failures and choose a response), but there is no 'Use when...' or equivalent trigger clause, so per the judging guidelines completeness is capped at 3 ('Has a clear what but when is missing or only weakly implied').

3 / 5

Trigger Term Quality

Relevant keywords like "CI failures", "PR", "stale", "classify" are present, but the most natural user phrasings for this domain — "flaky test", "retry CI", "CI is red/failing" — are missing. This fits 'Some relevant keywords but missing common variations or synonyms' rather than the level-4 anchor, which expects good coverage of natural terms.

3 / 5

Distinctiveness Conflict Risk

"stale PR CI failures" carves a fairly distinct niche that is unlikely to trigger for unrelated skills, fitting 'Mostly distinct; minor overlap risk with closely related skills' — it could still collide with general CI/PR triage or flaky-test management skills, so it is not a 5.

4 / 5

Total

13

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

QwenLM/qwen-code

Path

.qwen/skills/ci-flaky-patrol/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.