CtrlK
BlogDocsLog inGet started
Tessl Logo

gate-tests

How to use the `@gate` / `@force-gate` test directives instead of `it.skip` or fake-green skip patterns. Use when a test is known-failing under some test-matrix dimension (dev mode, a bundler, an experimental flag like cacheComponents), when converting `if (isNextDev) return` guards or env-var `describe.skip` branches, when adding a condition to test/lib/gate/conditions.ts, or when keying a fixture's experimental flag on a __NEXT_TEST_AXIS letter. Covers directive choice, condition tiers, the test-axis fixture pattern, pitfalls, and verification commands.

74

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality decision guide: actionable, correctly sequenced, with explicit per-state verification and hard-won pitfalls stated as rules rather than prose. The only weaknesses are mild redundancy around the off-state cost argument and no use of bundle files to split reference-grade detail out of SKILL.md.

Suggestions

Deduplicate the off-state cost discussion: directive items 3–4 and the 'Is the off-state run worth its cost?' section make the same argument, and 'test/e2e/app-dir/use-offline/' is cited three times — one canonical treatment would cut tokens without losing information.

Move the Pitfalls section (or the detailed test-axis pattern walkthrough) into a references/ file, keeping a one-line pointer and the highest-frequency pitfalls in SKILL.md, so the decision guide loads leaner while details stay one level deep.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence — it never explains what Jest, skip pragmas, or test fixtures are; every section carries non-obvious repo knowledge ('lazy conditions read the resolved config, never `process.env`', 'a pragma on a skipped test errors as ambiguous'). It is not a 5 because of repetition: the off-state cost calculus appears in directive item 3 and again nearly verbatim in 'Is the off-state run worth its cost?', and the working example 'test/e2e/app-dir/use-offline/' is cited three times. It is not a 3 because there is no padding and no explanation of concepts Claude already knows.

4 / 5

Actionability

Guidance is fully executable: a concrete next.config.js axis-keying example, the pragma form '// @gate concurrentRouterQueue', copy-paste verification commands with env vars ('NEXT_SKIP_ISOLATE=1 pnpm test-start-webpack test/e2e/app-dir/<suite>/<suite>.test.ts', '__NEXT_TEST_AXIS=A …', 'pnpm test-unit test/unit/gate/'), and named working examples to copy from. Specific examples cover the common cases (behavior flag, new API, impossible-to-run), matching the anchor for copy-paste-ready commands.

5 / 5

Workflow Clarity

The decision workflow is clearly sequenced by question type (items 1–5 under 'Choosing the directive'), and the verification section provides explicit validation checkpoints with expected outcomes per state ('expect normal passes, no warnings', 'expect `⚠ gated test failed as expected (@gate …)`', 'expect `○ skipped` at collection, no fixture boot') plus a unit-test command. The Pitfalls section supplies error-recovery guidance (hard errors, cascade failures, stalling bodies). This matches the anchor for clear sequence with explicit validation steps and feedback for recovery.

5 / 5

Progressive Disclosure

A single clearly-signaled, one-level-deep reference leads the document ('Full reference: test/lib/gate/README.md') and sections are well-organized with headers and a scannable anti-pattern table. It is not a 5 because the skill keeps all ~180 lines inline with no bundle files — the Pitfalls section and the detailed test-axis pattern are reference-grade material that could be split out; it is not a 3 because the one reference that does exist is prominently signaled and nothing is buried.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: it names the exact directives, enumerates concrete conversion scenarios with code-level triggers, and gives four explicit 'Use when' clauses. Voice is third person ('Covers…') and there is no fluff despite the density.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — 'How to use the `@gate` / `@force-gate` test directives instead of `it.skip`', 'converting `if (isNextDev) return` guards', 'adding a condition to test/lib/gate/conditions.ts', 'keying a fixture's experimental flag on a __NEXT_TEST_AXIS letter' — plus an explicit coverage list ('directive choice, condition tiers, the test-axis fixture pattern, pitfalls, and verification commands'). This matches the anchor for multiple specific concrete actions with comprehensive coverage; a 4 would require minor gaps, but every core capability of the skill is named.

5 / 5

Completeness

The 'what' is explicit up front ('How to use the `@gate` / `@force-gate` test directives instead of `it.skip` or fake-green skip patterns') and the 'when' is explicit with four concrete trigger clauses ('Use when a test is known-failing under some test-matrix dimension…, when converting…, when adding a condition…, or when keying a fixture's experimental flag…'). This clearly matches the anchor for explicitly answering both what and when with concrete trigger phrases; a 4 would require a less specific 'when'.

5 / 5

Trigger Term Quality

Natural trigger terms are comprehensive and include synonyms: 'it.skip', 'fake-green skip patterns', 'known-failing', 'describe.skip', 'dev mode', 'a bundler', 'experimental flag like cacheComponents', plus exact file/env tokens ('test/lib/gate/conditions.ts', '__NEXT_TEST_AXIS'). These are precisely the phrases a contributor in this repo would say when they need the skill, matching the anchor for comprehensive coverage including synonyms and specific identifiers.

5 / 5

Distinctiveness Conflict Risk

The niche is unambiguous: repo-specific tokens ('test/lib/gate/conditions.ts', '__NEXT_TEST_AXIS', '`if (isNextDev) return` guards', 'cacheComponents') pin the skill to this codebase's test-gating system, and the directive names '@gate' / '@force-gate' are unique triggers. Minimal conflict risk with any other skill; it would not fire for a wrong skill.

5 / 5

Total

20

/

20

Passed

Validation

75%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 12 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

relative_links

Relative link issues: 1 suspicious

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

12

/

16

Passed

Repository
vercel/next.js
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.