CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

job-failure-analyzer

Extract and analyze failure events from AAP jobs to classify errors and reconstruct failure timelines. Use when: - "Job #X failed", "Why did the execution fail?" - "Analyze the failed job", "What went wrong?" - "Show me the failure details" NOT for: host fact correlation (use host-fact-inspector) or resolution recommendations (use resolution-advisor).

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers a highly actionable, well-sequenced MCP workflow with concrete parameters, a decision table, an output template, and a worked example, supported by a real one-level-deep reference file. Weaker spots are trimmable duplication between the Workflow and Dependencies sections and missing edge-case checkpoints in the event-extraction flow.

Suggestions

Remove the duplicate tool list in the Dependencies section (or reduce it to a single line noting the tools are defined in the Workflow) to tighten conciseness.

Add explicit handling for edge cases in Step 3: what to do when no failure events are returned and how to paginate if events exceed page_size 100.

Either integrate jobs_stdout_retrieve into the workflow (e.g., when event_data.res.msg is missing) or drop it from allowed-tools/Dependencies, and link the classification table to the error-classification reference (fixing its dangling pointer) for a cleaner bundle.

DimensionReasoningScore

Conciseness

The body is efficient with no explanations of concepts Claude already knows, but the Dependencies section re-lists all four MCP tools already detailed in Workflow steps, and "When to Use This Skill" largely duplicates the frontmatter triggers. This is minor trimmable redundancy, matching the anchor 4 rather than the every-token-earns-its-place anchor 5.

4 / 5

Actionability

Every step gives the exact MCP tool name, parameters, the specific fields to extract, a concrete classification decision table, a complete output template, and a fully worked example trace. Guidance is copy-paste ready for the tool-invocation domain and covers the common case end to end.

5 / 5

Workflow Clarity

Seven steps are clearly sequenced with a mandatory-first document consultation, status-based branching (failed/error/canceled), and prerequisite validation. However, there are no checkpoints for edge cases (empty event results, events beyond page_size 100) and jobs_stdout_retrieve is declared as supplementary but never placed in the sequence — minor validation gaps that fit anchor 4 rather than the feedback-loop-rich anchor 5.

4 / 5

Progressive Disclosure

Good structure: the body stays an overview and repeatedly signals the one-level-deep reference references/aap/job-troubleshooting.md, which exists as a real 396-line file. Minor gaps: the classification table could link the error-classification taxonomy (references/error-classification.md is only a dangling cross-skill pointer stub), and the bundle contains empty sibling pointer stubs, so navigation is not fully clean.

4 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that states concrete capabilities in third person, provides explicit and natural trigger phrases, and cleanly disambiguates against sibling skills. The only weaknesses are minor: a few missing action details and trigger synonyms like "troubleshoot".

DimensionReasoningScore

Specificity

"Extract and analyze failure events from AAP jobs to classify errors and reconstruct failure timelines" names the domain and several specific concrete actions. Minor coverage gaps (e.g., host summary mapping and report generation are not mentioned), so it fits the 'several specific actions; minor gaps' anchor rather than the fully comprehensive anchor above.

4 / 5

Completeness

It explicitly answers both what ("Extract and analyze failure events... classify errors and reconstruct failure timelines") and when (a concrete "Use when" list of quoted trigger phrases), plus a NOT-for boundary. This clearly matches the top anchor rather than the 'when could be more explicit' anchor at 4.

5 / 5

Trigger Term Quality

Natural user phrases like "Job #X failed", "Why did the execution fail?", "Analyze the failed job", and "What went wrong?" give good keyword coverage. Common variations such as "troubleshoot" or "debug the job" are missing, keeping it below the comprehensive-synonyms anchor.

4 / 5

Distinctiveness Conflict Risk

A clear niche (AAP job failure analysis) with distinct triggers and an explicit "NOT for: host fact correlation (use host-fact-inspector) or resolution recommendations (use resolution-advisor)" boundary, minimizing conflict risk with sibling skills.

5 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 3 deeper-than-1-level

Warning

referenced_paths_exist

Referenced path issues: 3 deeper-than-1-level

Warning

Total

13

/

16

Passed

Repository

RHEcosystemAppEng/agentic-plugins

Path

rh-automation/skills/job-failure-analyzer/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.