CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

axiom-analyze-test-failures

Use when the user mentions flaky tests, tests that pass locally but fail in CI, race conditions in tests, or needs to diagnose WHY a specific test fails.

Quality

74%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./axiom-codex/skills/axiom-analyze-test-failures/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-structured pattern catalog with executable code, exact search commands, and validation checkpoints. Its weaknesses are duplication (the output template restates pattern fixes), a sequencing contradiction around crash-report-first analysis, and a monolithic single-file layout with no reference files despite the size.

Suggestions

Resolve the ordering conflict: move the .ips crash check to the top of the Audit Process (or reference it from Step 1) so the numbered steps reflect Pattern 6's "Before analyzing the Swift source" rule.

Trim the Output Format example to a skeleton (summary counts, one worked CRITICAL issue, severity sections) instead of restating Pattern 1's full fix verbatim, and cut the five Invocation Examples to one or two.

Split the pattern catalog and the XCTest legacy section into references/ files (e.g., references/patterns.md, references/xctest-legacy.md) and keep SKILL.md as an overview with the audit process and links.

DimensionReasoningScore

Conciseness

The body is mostly high-value and correctly avoids explaining basics Claude knows, but there is noticeable duplication: the ~90-line Output Format example repeats Pattern 1's full confirmation/withCheckedContinuation fix verbatim, and five Invocation Examples restate triggers already covered by the patterns. This fits 'mostly efficient but includes some unnecessary explanation or could be tightened' rather than level 4's 'minor instances'.

3 / 5

Actionability

Fully executable throughout: concrete grep regexes per pattern, complete ❌/✅ Swift code pairs, a one-call crash triage command ("xcsym crash --format=summary <path-to-ips>"), a pattern_tag routing table, and copy-paste verification commands ("swift test --filter \"TestName\" --maximum-repetitions 100"). Common cases are covered with specifics, matching the top anchor.

5 / 5

Workflow Clarity

The Audit Process is a clear 3-step sequence (Glob → per-pattern Grep → read 20 lines context and "Verify it's a real issue (not false positive)") with a false-positives checklist and post-fix verification commands. Not 5 because Pattern 6 says "Before analyzing the Swift source, read and symbolicate the crash", yet the Audit Process sequences the crash-report check 6th of 7 — an agent following the numbered steps top-down would scan source patterns before checking for .ips files.

4 / 5

Progressive Disclosure

No bundle files exist; everything is inlined in a ~460-line SKILL.md. Internal structure is good (per-pattern sections with Issue/Why/Detection), but content that belongs in reference files is inlined — the 7-pattern catalog, the XCTest legacy section, and the full output-format template would each work as a one-level-deep reference. This matches 'some structure but could be better organized; content that should be separate is inline'; the good sectioning keeps it above level 2.

3 / 5

Total

15

/

20

Passed

Description

65%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A trigger-first description with excellent, natural user phrasing but a weak statement of capability. The when-clause is explicit and specific; the what reduces to one generic verb ("diagnose") with no concrete actions named.

Suggestions

Lead with the what before the when: e.g., "Scans Swift Testing suites for flakiness patterns (missing confirmation, missing @MainActor, shared mutable state, timing-dependent assertions) and symbolicates test crash reports. Use when the user mentions flaky tests..."

Add common synonyms to the triggers: "intermittent test failures", "tests fail randomly", "unstable in CI".

Scope the trigger to Swift Testing / Swift 6 concurrency so it does not compete with general debugging skills for non-Swift flaky tests.

DimensionReasoningScore

Specificity

The only action stated is "needs to diagnose WHY a specific test fails", which is generic — the description never says what the skill actually does (scan the codebase for Swift Testing flakiness patterns, symbolicate crash reports, etc.). It names the domain (flaky-test diagnosis) but the actions are minimal, matching the anchor 'Names the domain but actions are minimal or generic' rather than level 3, which requires 1-2 concrete actions.

2 / 5

Completeness

Both parts are present: an explicit trigger clause ("Use when the user mentions flaky tests...") and a what ("diagnose WHY a specific test fails"). Not 5 because the what is thin — it omits the actual capability (analyzing the codebase for Swift Testing concurrency patterns) — while the anchor-5 example pairs an equally explicit what with the when.

4 / 5

Trigger Term Quality

"flaky tests", "tests that pass locally but fail in CI", and "race conditions in tests" are natural phrases users would say verbatim. Not 5 because common synonyms like "intermittent failures", "tests fail randomly", or "unstable tests" are missing.

4 / 5

Distinctiveness Conflict Risk

The flaky-test/CI-failure triggers form a clear niche distinct from most skills. Not 5 because the description does not scope to Swift/iOS, so it would also fire for flaky tests in any language or framework, creating minor overlap with general debugging and test-writing skills.

4 / 5

Total

14

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

CharlesWiltgen/Axiom

Path

axiom-codex/skills/axiom-analyze-test-failures/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.