CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ci-triage

Classify CI failures — distinguish clear regressions from infra flakes and security-test failures. Produces structured failure reports.

Quality

77%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./starters/ci-sweeper-opencode/skills/ci-triage/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

80%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A tight, well-structured instruction skill with lean categories, concrete output requirements, and useful safety rules; its main weakness is workflow clarity — the classify-act-update flow is implicit and the batch auto-fix loop lacks a verify-before-counting-again checkpoint. Adding an explicit validation step after each fix attempt would resolve the only real gap.

Suggestions

Add a validation checkpoint to the fix loop, e.g., 'After each fix attempt, re-run the failing check; only count an attempt and update ci-sweeper-state.md once the result is observed.'

Present the operating sequence explicitly (numbered steps: fetch failures -> classify -> retry non-deterministic ones -> act -> update state file) rather than leaving it implied by section order.

Briefly specify what an auto-fix attempt concretely includes (e.g., where changes are made under worktree isolation) to close the actionability gap.

DimensionReasoningScore

Conciseness

The body is lean and categorical — classification bullets, a named output file with three fields, and three terse rules — with no explanation of concepts Claude already knows. The untrusted-input block is substantive safety guidance, not padding, so every token earns its place.

5 / 5

Actionability

Concrete, instruction-only guidance: a specific output target 'ci-sweeper-state.md' with exact fields, decision rules ('retry once before classifying', 'Max 3 fix attempts per item', 'Infra and security failures always escalate'), and category examples ('network timeout, runner issue, dependency unavailable'). Gaps remain around how failures are fetched and what an auto-fix concretely involves, so it falls short of fully executable.

4 / 5

Workflow Clarity

A rough sequence exists (classify, retry if non-deterministic, act, update state) with rules, but the batch auto-fix workflow lacks verification checkpoints — e.g., re-running the failing check after a fix attempt before incrementing the attempt count. Per the guidelines, missing validation in a batch/destructive workflow caps this at 3.

3 / 5

Progressive Disclosure

The skill is under 50 lines, needs no external reference files (no references/, scripts/, or assets/ exist in the bundle), and is organized into clear, well-labeled sections, which satisfies the simple-skill exception for a top score.

5 / 5

Total

17

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A specific, third-person description with good domain keywords and a clear 'what', but it omits any explicit 'when to use' trigger guidance, which both caps completeness and weakens its trigger coverage. Adding a 'Use when...' clause citing natural user phrases would lift the two weakest dimensions.

Suggestions

Append a trigger clause such as 'Use when a CI check fails, a test looks flaky, or the user asks to triage a broken build.'

Include common user synonyms in the description — 'flaky tests', 'triage', 'broken build' — to broaden natural trigger matching.

Optionally mention the escalation and retry behavior to round out capability coverage toward the comprehensive anchor.

DimensionReasoningScore

Specificity

The description lists several concrete actions — 'Classify CI failures', 'distinguish clear regressions from infra flakes and security-test failures', 'Produces structured failure reports' — with named failure categories. Coverage has minor gaps (retry, escalation, and state-file updates are not mentioned), keeping it below the comprehensive anchor at 5.

4 / 5

Completeness

The 'what' is clear (classify failures into three categories and produce structured reports), but there is no 'Use when...' clause or equivalent explicit trigger guidance, which caps completeness at 3 per the judging guidelines.

3 / 5

Trigger Term Quality

Terms like 'CI failures', 'infra flakes', 'regressions', and 'security-test failures' are natural phrases users would say in this domain. A few common variations are missing ('flaky tests', 'triage', 'broken build'), so it does not reach comprehensive synonym/extension coverage.

4 / 5

Distinctiveness Conflict Risk

CI failure triage is a distinct niche with specific trigger terms (flakes, regressions, security-test failures). Minor overlap risk remains with general debugging or test-fixing skills that could also trigger on failing-test mentions, keeping it below a 5.

4 / 5

Total

15

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

cobusgreyling/loop-engineering

Path

starters/ci-sweeper-opencode/skills/ci-triage/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.