CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

troubleshooting-application-failures

Troubleshoots failing applications by discovering and analyzing CloudWatch log groups to identify error patterns, root causes, and actionable solutions. Use when an application is experiencing failures and log-based diagnosis is needed.

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is troubleshooting-application-failures in aws/agent-toolkit-for-aws

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The SKILL.md body is an exemplary progressive-disclosure overview: lean, well-organized, delegating the multi-step procedure to a single real reference file with concrete CLI-based instructions. The only minor gap is that the body summarizes neither the procedure's step sequence nor its validation checkpoints, deferring them entirely to the reference.

DimensionReasoningScore

Conciseness

The ~28-line body is lean with no padding: a two-sentence Overview, a single delegation instruction ("follow the procedure exactly"), and three brief troubleshooting entries with concrete specifics. It assumes Claude's competence and every token earns its place, matching anchor 5; there is no unnecessary concept explanation that would drop it to anchor 4.

5 / 5

Actionability

The troubleshooting section gives concrete, executable specifics — exact IAM permissions ("logs:DescribeLogGroups", "logs:StartQuery", "logs:GetQueryResults") and log group patterns ("/aws/lambda/function-name") — and the main procedure is delegated to a real reference file containing concrete aws CLI commands. This fits anchor 4 (mostly executable, minor gaps): the body itself contains no commands for the core workflow, relying entirely on the reference, so it is not fully copy-paste ready as anchor 5 requires.

4 / 5

Workflow Clarity

The single main step is unambiguous ("follow the procedure exactly" with a well-labeled reference), and the referenced procedure (verified) contains explicit validation checkpoints (e.g., "Validate Log Groups and Check Availability", verifying log streams before querying). This matches anchor 4 (clear sequence with most checkpoints present); it is not anchor 5 because the body itself does not summarize the step sequence or validation points, leaving a minor gap for a reader who stays in SKILL.md.

4 / 5

Progressive Disclosure

The body is a clean overview with one clearly signaled, one-level-deep reference ([Application failure troubleshooting procedure](references/application-failure-troubleshooting.md)) that exists and itself contains no nested references. Brief fallback guidance (troubleshooting subsections) is appropriately inlined, matching anchor 5 (clear overview, well-signaled one-level-deep references, easy navigation).

5 / 5

Total

18

/

20

Passed

Description

75%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A solid description with an explicit "Use when" clause, third-person voice, and a well-scoped CloudWatch log troubleshooting niche. It is consistently just short of top marks: trigger coverage misses common phrasings (debug, errors, crashes), and the "when" clause leans on the abstract "log-based diagnosis is needed" phrasing.

Suggestions

Broaden trigger terms with natural user phrasings such as "debug", "errors", "crashes", or "application is down" to lift trigger term coverage and distinctiveness.

Make the "Use when" clause more concrete, e.g., "Use when the user reports application failures, errors, or crashes in AWS and log-based diagnosis is needed".

DimensionReasoningScore

Specificity

The description lists several concrete actions — "discovering and analyzing CloudWatch log groups", "identify error patterns, root causes, and actionable solutions" — covering most of the workflow with minor gaps (e.g., "actionable solutions" is generic and remediation generation is only implied). It matches anchor 4 (several specific actions, minor gaps) rather than anchor 5, which demands comprehensive coverage, and is clearly above anchor 3, which expects only 1-2 concrete actions.

4 / 5

Completeness

It answers both questions explicitly: what ("Troubleshoots failing applications by discovering and analyzing CloudWatch log groups...") and when ("Use when an application is experiencing failures and log-based diagnosis is needed"). The "when" clause is present but "log-based diagnosis is needed" is somewhat abstract rather than a concrete user trigger phrase, matching anchor 4 rather than anchor 5's fully concrete triggers, and well above anchor 3 (weak or missing "when").

4 / 5

Trigger Term Quality

Natural terms include "failing applications", "failures", "CloudWatch", "log", and "diagnosis", which users would plausibly say. It falls at anchor 4 (good keyword coverage, a few natural terms missing) because common phrasings like "debug", "errors", "crashes", or "app is down" are absent; it is well above anchor 3's sparse keyword set.

4 / 5

Distinctiveness Conflict Risk

The CloudWatch log-analysis niche is clearly bounded and unlikely to trigger unrelated skills, fitting anchor 4 (mostly distinct, minor overlap risk). It is not anchor 5 because adjacent AWS skills (e.g., CloudWatch metrics monitoring or general AWS debugging skills) could plausibly compete for similar failure-reporting triggers.

4 / 5

Total

16

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Repository

mreferre/aws-agent-toolkit-skills

Path

.kiro/skills/troubleshooting-application-failures/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.