CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/e2e-suite-budget

Use when CI is slow or dominated by end-to-end tests, flaky failures are rising, or for a quarterly suite review. Ranks every E2E test by ROI (regressions caught vs runtime, flake rate and maintenance) and recommends which to retire, move to a lower layer or fix.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is a well-structured, highly actionable workflow: a defined ROI formula, executable scoring code, validation checkpoints with feedback loops, a realistic output template, and a verified worked example. Its only notable gap is that the scoring script omits the input-validation logic the surrounding workflow mandates, and a few sections could be marginally tighter.

DimensionReasoningScore

Conciseness

The body is dense and operational — formula, runnable code, output template, decision table, worked example — with no tutorials on concepts Claude already knows. Minor instances could be trimmed ("Higher ROI = more value per cost", the 'How to use' list restating the step headers, the sibling-skill blurbs), placing it at anchor 4 rather than the every-token-earns-its-place anchor 5.

4 / 5

Actionability

Step 3 provides complete, executable Python with defined JSON input formats, plus a concrete ROI formula, a YAML budget config, a fill-in output template, and a worked example whose ROI numbers verify against the formula. It falls just short of anchor 5 because the script does not implement the Step 1a validation and would raise KeyError on a missing runtime_min or crash on a null flake_rate.

4 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced with inline cross-references (e.g., "flag and exclude gaps (Step 1a)"), and Step 1a is an explicit validation checkpoint with feedback loops: SKIP flagging for missing runtime, NEEDS MANUAL REVIEW exclusion for missing flake data, ID-set mismatch logging, and a >50%-zero sanity check that warns before recommendations are generated. This matches anchor 5; the batch-operation cap does not apply because validation is present.

5 / 5

Progressive Disclosure

The core workflow is appropriately inline while edge content (failure modes and known constraints) is split into a single, clearly-signaled, one-level-deep reference file that exists in the bundle and is summarized at the point of the link. This matches anchor 5; the only nit is the awkward `[tp][tp]` reference-style link formatting, which is not an organization gap.

5 / 5

Total

18

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly covers both what the skill does and when to use it, with concrete trigger phrases and specific, jargon-free language. The only weaknesses are minor: a couple of missing natural trigger phrasings around suite size, and slight overlap risk with a flake-triage skill on the flakiness trigger.

DimensionReasoningScore

Specificity

"Ranks every E2E test by ROI (regressions caught vs runtime, flake rate and maintenance) and recommends which to retire, move to a lower layer or fix" names the domain and multiple concrete actions with the ROI inputs spelled out. It sits at anchor 4 rather than 5 because capabilities like input gathering and budget-cap enforcement are not mentioned, but it is well above the 1-2-action coverage of anchor 3.

4 / 5

Completeness

It opens with an explicit "Use when..." clause listing three concrete triggers and follows with a clear, specific statement of what the skill does (rank by ROI with named inputs; recommend retire / lower layer / fix). Both what and when are explicit with concrete trigger phrases, matching anchor 5 rather than the weaker 'when' of anchor 4.

5 / 5

Trigger Term Quality

Natural phrases users would say are present — "CI is slow", "dominated by end-to-end tests", "flaky failures are rising", "quarterly suite review" — with both "E2E" and "end-to-end" synonyms. A few common phrasings are missing (e.g., "too many tests", "test suite bloat", "trim the test suite"), so it fits anchor 4 rather than comprehensive anchor 5.

4 / 5

Distinctiveness Conflict Risk

The niche (E2E suite ROI pruning and retirement decisions) is distinct with specific triggers, but "flaky failures are rising" could also naturally invoke a dedicated flake-triage skill. That minor overlap with a closely related skill places it at anchor 4 rather than the minimal-conflict anchor 5.

4 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page