CtrlK
BlogDocsLog inGet started
Tessl Logo

debugging-e2e-tests

Use when an Opik E2E test has failed and a developer wants it investigated — e.g. "why did this e2e test fail?", "investigate the failing run on my PR", "is dataset-crud-smoke flaky?", "the nightly e2e suite went red". Takes a failure from a CI check, a TestOps launch, a test name, or a local run; gathers the trace and history, classifies regression vs. flake, and proposes a fix. Read-only — it diagnoses and proposes, it does not edit tests.

72

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable read-only diagnostic skill: concrete commands, clear sequencing, and useful guardrails. It loses a point mainly for slight ceremony in the diagram/announce line, a few guidance-level steps, and the absence of any file-based progressive disclosure.

Suggestions

Replace or trim the DOT diagram and 'Announce at start' line — the numbered steps and prose already convey the sequence, so these add tokens without adding guidance.

Make the remaining guidance-level steps concrete: give an example git diff command for 'diff the suspected change against the failing test's code path'.

Consider moving the validated MCP call catalog and TestOps launch-naming convention into a references/ file, keeping SKILL.md as an overview that links to it.

DimensionReasoningScore

Conciseness

Lean and assumes Claude's competence — no padding about what Playwright, Allure, or traces are; just where evidence lives and validated commands. The DOT diagram and 'Announce at start' line are slightly ceremonial relative to the numbered steps that follow, keeping it just below the top anchor.

4 / 5

Actionability

Highly executable with copy-paste-ready validated MCP calls (list_launches(projectId: 1, search: ..., sort: ['createdDate,DESC'])), gh run download flags, and npx playwright show-trace. A few steps (e.g. 'diff the suspected change') are guidance-level rather than concrete commands, leaving minor gaps.

4 / 5

Workflow Clarity

Clear five-step sequence reinforced by a DOT diagram, with decision guardrails (skip history gracefully when TestOps is unreachable; default to flake/uncertain; verify render before blaming backend). These are decision rules more than explicit validate->fix->retry checkpoints, so it sits at 4 rather than 5.

4 / 5

Progressive Disclosure

Well-organized into clear sections (boundaries, evidence locations, tooling, the loop) with no broken or buried references. No bundle files exist and none are referenced; some inlined detail (validated call catalog, launch-naming convention) could be split into a reference file, a minor organization gap.

4 / 5

Total

16

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An excellent description: third-person voice, explicit 'Use when' clause, verbatim trigger phrases, concrete actions, and a stated boundary that distinguishes it from sibling skills. It cleanly satisfies every dimension.

DimensionReasoningScore

Specificity

Names the domain plus multiple concrete actions — 'gathers the trace and history, classifies regression vs. flake, and proposes a fix' — and enumerates four entry points (CI check, TestOps launch, test name, local run), giving comprehensive concrete coverage.

5 / 5

Completeness

Explicitly answers both what ('gathers the trace and history, classifies regression vs. flake, and proposes a fix') and when ('Use when an Opik E2E test has failed...') with concrete trigger phrases, hitting the top anchor.

5 / 5

Trigger Term Quality

Quotes verbatim natural user phrases ('why did this e2e test fail?', 'investigate the failing run on my PR', 'is dataset-crud-smoke flaky?', 'the nightly e2e suite went red') plus synonyms (e2e, nightly suite, flaky), matching the comprehensive-synonyms anchor.

5 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (failed Opik E2E tests), states a read-only boundary, and is explicitly distinguished from the writing-e2e-tests skill, minimizing wrong-skill triggering.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
comet-ml/opik
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.