CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ci-test-job-conventions

Use when designing how tests run in CI on any platform (GitHub Actions, GitLab CI, Jenkins, CircleCI): how many shards, which failures are safe to retry, quarantine, artifact retention, per-PR vs nightly cadence, cancel-on-push, timeouts and secrets. CircleCI config patterns are in its references.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/ci-test-job-conventions

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

High-quality conventions skill: specific, executable decision tables with a worked example, a sequenced how-to procedure with an explicit re-check checkpoint, and clean splitting of mechanism details into one-level-deep reference files. The only trims available are redundant repeated links and overlapping reference-section prose.

DimensionReasoningScore

Conciseness

The body is dense, table-driven decision content with essentially no explanation of concepts Claude already knows, but there is minor trimmable redundancy: references/junit-and-cache-lookups.md is linked four times across sections, and the 'Deep references' and 'References' sections partially duplicate each other — 'minor instances that could be trimmed' rather than every token earning its place.

4 / 5

Actionability

Guidance is fully concrete and executable: exact shard counts, timeout minutes per job type, retention-day bands, copy-paste-ready snippets (the GHA concurrency YAML with cancel-in-progress, `echo "::add-mask::$VALUE"`), and a worked example that applies every step to a common case (a 25-minute Playwright E2E suite on GitHub Actions).

5 / 5

Workflow Clarity

The 'How to use this reference' section gives a clearly sequenced six-step procedure with section pointers, capped by an explicit checkpoint ('Then re-check the workflow against the conventions below'), and the worked example walks the same sequence — but there is no fix-and-retry feedback loop, keeping it below the anchor requiring 'feedback loops for error recovery'.

4 / 5

Progressive Disclosure

SKILL.md stays a decision surface (§1-§9 matrices) while mechanism lookups are correctly split into two real, well-signaled reference files (circleci.md, junit-and-cache-lookups.md), both verified to exist and to be one level deep with no nested references; section numbering and the 'Deep references' descriptions make navigation easy.

5 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit 'Use when' trigger guidance paired with a comprehensive, concrete enumeration of the skill's decision domains and the four CI platforms it covers. The only weaknesses are a few missing natural synonyms (e.g., 'flaky', 'parallelize') and minor trigger overlap with the per-platform CI skills it complements.

DimensionReasoningScore

Specificity

The description enumerates eight concrete decision areas — "how many shards, which failures are safe to retry, quarantine, artifact retention, per-PR vs nightly cadence, cancel-on-push, timeouts and secrets" — comprehensively covering the skill's scope, matching the anchor for multiple specific concrete items with comprehensive coverage rather than anchor 4's 'several actions with minor gaps'.

5 / 5

Completeness

It opens with an explicit trigger clause — "Use when designing how tests run in CI on any platform" — and then fully enumerates the what (shards, retries, quarantine, retention, cadence, cancel-on-push, timeouts, secrets), clearly and explicitly answering both what and when with concrete trigger phrases; anchor 4's '"when" could be more explicit' does not apply.

5 / 5

Trigger Term Quality

Good natural keyword coverage — "tests run in CI", "GitHub Actions", "GitLab CI", "Jenkins", "CircleCI", "shards", "retry", "nightly", "timeouts", "secrets" — but common user phrasings like "flaky tests", "pipeline", or "parallelize tests" are absent, placing it at 'good coverage; a few natural terms missing' rather than comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

The cross-platform conventions niche (what to express, not how) is distinct, but naming all four CI platforms creates minor trigger overlap with the closely related per-CI implementation skills the body itself references — 'mostly distinct; minor overlap risk with closely related skills' rather than minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 3 missing

Warning

Total

15

/

16

Passed

Repository

testland/qa

Path

plugins/qa-ci-integration/skills/ci-test-job-conventions/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.