CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/ci-test-job-conventions

Use when designing how tests run in CI on any platform (GitHub Actions, GitLab CI, Jenkins, CircleCI): how many shards, which failures are safe to retry, quarantine, artifact retention, per-PR vs nightly cadence, cancel-on-push, timeouts and secrets. CircleCI config patterns are in its references.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built conventions skill: dense decision tables with exact values, copy-paste config snippets for all four CI platforms, a clear stepwise procedure reinforced by a worked example, and clean separation of deep material into two real, one-level-deep reference files. Remaining polish is minor — trimming a few redundant lines/links and turning the final re-check into an explicit checklist.

DimensionReasoningScore

Conciseness

The body is efficient and dense — decision matrices, exact values, and one-line rationales with no explanation of concepts Claude already knows. Minor trims exist: the sharding definition ("Sharding splits a test suite across N parallel jobs"), a restated goal in §9, and reference links duplicated between 'Deep references' and the 'References' section. That matches anchor 4's 'minor instances that could be trimmed', not anchor 5's every-token-earns-its-place.

4 / 5

Actionability

For a conventions/decision skill, guidance is concrete and copy-paste ready throughout: exact shard counts ("2-4 shards", "4-8 shards"), "Maximum 1 framework-level retry", per-artifact retention days, the GitHub Actions concurrency YAML snippet, `echo "::add-mask::$VALUE"`, `interruptible: true`, `disableConcurrentBuilds()`, and per-job timeout values. Specific examples cover the common cases across all four CI platforms, matching anchor 5.

5 / 5

Workflow Clarity

'How to use this reference' gives a clearly sequenced 6-step procedure with § cross-references, closes with an explicit re-check step ("re-check the workflow against the conventions below"), and the worked example walks a concrete 25-minute Playwright case end-to-end. However, the final validation is a single sentence rather than an explicit checklist or error-recovery loop, so it sits at anchor 4 rather than anchor 5.

4 / 5

Progressive Disclosure

The body is a decision surface with §-numbered sections, and the two deep-dive files (references/junit-and-cache-lookups.md, references/circleci.md) exist, are one level deep (no nested references), and are well signaled with descriptions of what each contains and why it lives outside the main file. Content split is appropriate — per-CI detail is out, decision matrices are inline — matching anchor 5's clear overview with well-signaled one-level-deep references.

5 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit 'Use when' trigger with all four major CI platforms named, and a comprehensive, concrete enumeration of the convention areas the skill governs. The only gaps are a few natural trigger variations (e.g. 'flaky tests') and mild adjacency to per-platform CI skills.

DimensionReasoningScore

Specificity

The description enumerates concrete capabilities across the whole domain — "how many shards, which failures are safe to retry, quarantine, artifact retention, per-PR vs nightly cadence, cancel-on-push, timeouts and secrets" — covering every section of the skill with no vague filler. It is comprehensive within its scope rather than listing only 1-2 actions (anchor 3) or leaving minor gaps (anchor 4).

5 / 5

Completeness

Both halves are explicit: the what is a detailed enumeration of the convention areas (sharding, retry classes, quarantine, retention, cadence, concurrency, timeouts, secrets), and the when is an explicit "Use when designing how tests run in CI on any platform (GitHub Actions, GitLab CI, Jenkins, CircleCI)" with concrete trigger phrases. This matches anchor 5; anchor 4 would require the 'when' to be less explicit or specific, which is not the case.

5 / 5

Trigger Term Quality

Strong natural keyword coverage: users would say "GitHub Actions", "GitLab CI", "Jenkins", "CircleCI", "shards", "retry", "quarantine", "artifact retention", "timeouts", "secrets". It misses a few common variations users would naturally say, e.g. "flaky tests", "parallelize", or "CI config", so it does not reach anchor 5's comprehensive synonym coverage; it is clearly above anchor 3's partial coverage.

4 / 5

Distinctiveness Conflict Risk

It carves a clear niche — cross-platform test-job conventions ("on any platform") rather than platform syntax — with the platform names as triggers, so it is mostly distinct. There is minor overlap risk with closely related per-CI skills (a user asking about a GitHub Actions test workflow could plausibly trigger either), which keeps it below anchor 5's minimal-conflict bar but above anchor 3's generic overlap.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 3 missing

Warning

Total

15

/

16

Passed

Reviewed

On this page