CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

debugging-e2e-tests

Use when an Opik E2E test has failed and a developer wants it investigated — e.g. "why did this e2e test fail?", "investigate the failing run on my PR", "is dataset-crud-smoke flaky?", "the nightly e2e suite went red". Takes a failure from a CI check, a TestOps launch, a test name, or a local run; gathers the trace and history, classifies regression vs. flake, and proposes a fix. Read-only — it diagnoses and proposes, it does not edit tests.

Quality

95%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, highly operational body: every step is executable with real commands, paths, and decision rules, and the workflow includes genuine fallback and evidence-grounding checkpoints. The main quality costs are a redundant graphviz diagram duplicating the step list and dense tooling detail that could live in a reference file.

Suggestions

Remove the graphviz "loop" diagram — the five '### Step' headings that follow it already convey the identical sequence in less than a third of the tokens.

Consider moving the TestOps specifics (launch-naming conventions, artifact/retention details, full MCP call signatures) into a references/testops.md file, leaving SKILL.md a leaner overview with one-level-deep pointers.

Trim the opening paragraph, which restates the frontmatter description almost verbatim.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence (no explaining what Playwright/Allure are), but the graphviz "loop" diagram spends ~15 lines restating the five step headings that immediately follow it, and the opening paragraph largely restates the frontmatter description. Efficient overall with a few trimmable instances — matches anchor 4 rather than 5's 'every token earns its place'.

4 / 5

Actionability

Guidance is copy-paste executable throughout: exact MCP calls with parameters ("list_launches(projectId: 1, search: \"<run_id or name fragment>\", sort: [\"createdDate,DESC\"])", "list_test_results(launchId)", "get_test_result_history(id)"), concrete CLI commands ("gh run download <run-id> -n test-results-v2 -D <dir>", "npx playwright show-trace <trace.zip>"), real paths and artifact names, and even launch-naming conventions. As an instruction-only skill, the absence of code blocks is fully compensated by specific, runnable guidance.

5 / 5

Workflow Clarity

A clear five-step sequence with explicit decision criteria in step 3 (pass-streak + related diff → regression; intermittent + no diff or TestOps `flaky: true` → flake; "default to flake/uncertain" tie-breaker), error-recovery fallbacks ("Skip history gracefully when TestOps isn't reachable... fall back to trace + diff reasoning"), and validation checkpoints in steps 4–5 ("grounded in cited evidence... not speculation", "each cited"). No destructive/batch operations, so no validation cap applies.

5 / 5

Progressive Disclosure

No bundle files exist (references/, scripts/, assets/ are absent) and the body is uniformly well-sectioned with clear headers, making navigation easy. However, at ~90 lines with dense operational detail — TestOps launch-naming conventions, artifact retention policy, and full MCP call signatures — some of the Tooling/evidence material could be offloaded to a reference file to keep SKILL.md a leaner overview; a minor organization gap that fits anchor 4 better than the reference-structured or under-50-line cases for 5.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: third-person, dense without padding, with real user-voice trigger phrases, complete what/when coverage, and explicit scope boundaries that prevent mis-triggering against related skills. Every clause either states a capability or a trigger.

DimensionReasoningScore

Specificity

"Takes a failure from a CI check, a TestOps launch, a test name, or a local run; gathers the trace and history, classifies regression vs. flake, and proposes a fix" lists multiple concrete actions with comprehensive coverage — inputs, evidence gathering, classification, output, and a read-only boundary. Not 4: coverage extends beyond 'several actions with minor gaps' to the full investigate→classify→propose loop plus entry points and scope limits.

5 / 5

Completeness

Explicitly answers 'when' with a leading "Use when an Opik E2E test has failed..." plus concrete quoted trigger phrases, and 'what' with the gather/classify/propose actions and the read-only scope. Both halves are explicit and concrete, matching the top anchor.

5 / 5

Trigger Term Quality

Quotes the literal phrases users would say — "why did this e2e test fail?", "investigate the failing run on my PR", "is dataset-crud-smoke flaky?", "the nightly e2e suite went red" — plus synonyms (failed/failing, flaky, red) and a concrete test name example. Matches the anchor for comprehensive natural-term coverage including variations.

5 / 5

Distinctiveness Conflict Risk

The niche is narrow (failed Opik E2E test investigation) and the description actively disambiguates from sibling skills via "Read-only — it diagnoses and proposes, it does not edit tests". Triggers (e2e failure, flaky test, red nightly suite) are distinct from authoring/running skills, so conflict risk is minimal.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

comet-ml/opik

Path

.agents/skills/debugging-e2e-tests/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.