CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

update-os-coverage

Update OS version references in Helix queue definitions to add new versions, replace EOL versions, or audit coverage against the supported-os matrix. USE FOR: adding new OS versions to Helix queues, replacing EOL OS versions, upgrading "oldest" or "latest" version references, auditing Helix coverage. DO NOT USE FOR: creating new container images (that's dotnet-buildtools-prereqs-docker), updating supported-os.json (that's the update-supported-os skill in dotnet/core).

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

—

The risk profile of this skill

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-sequenced operational skill whose repo-specific knowledge (naming conventions, pipeline gating, validation workflow) is genuinely valuable. Its main weakness is monolithic structure — the naming and CI-coverage reference tables are inlined rather than split into reference files — plus minor repetition that hurts token efficiency.

Suggestions

Move the per-distro naming-convention table (step 4.3) and the CI-pipeline-coverage tables (step 6) into dedicated reference files (e.g. references/naming-conventions.md and references/ci-coverage.md), keeping only a brief summary and a clearly signaled link in SKILL.md.

Deduplicate repeated guidance: state the MCR registry tag-list URL once (e.g. in a Reference section) and consolidate the servicing-branch conservatism rule, which currently appears in 'When to use', step 7, and step 8.

Trim the in-flux image-info callout in step 1 to two or three sentences and link the docker-tools#2142 issue for detail, keeping only the actionable instruction: trust the registry tag list, treat image-info JSON as a possibly-stale cross-check.

DimensionReasoningScore

Conciseness

The body is dense with genuinely non-obvious repo-specific detail (queue naming patterns, _internal counterparts, isExtraPlatformsBuild gating, image-info flux) and explains nothing Claude already knows, but the MCR registry URL is repeated three times, the servicing-branch conservatism guidance appears in three places, and the in-flux image-info callout runs long. Anchor 4 ('efficient; minor instances of over-explanation that could be trimmed'), not 5 — the repetition does not earn its tokens.

4 / 5

Actionability

Fully executable, copy-paste-ready commands throughout: curl + jq against the MCR tag list, gh search issues, the grep scan across named files, git show for release branches, and gh pr comment for the pipeline trigger, plus concrete naming-convention tables and explicit parameterized placeholders. Anchor 5 — specific examples cover the common cases; not 4 because there are no pseudocode gaps.

5 / 5

Workflow Clarity

Nine clearly sequenced steps with a dedicated validation step (re-grep for stale references, verify new tags exist in the registry, confirm only value fields changed), an explicit stop-and-inform failure path when the image tag is missing, and a CI-coverage cross-reference decision step. This is a batch operation with explicit validation and a feedback loop, matching anchor 5; not 4 because checkpoints are explicit rather than implied.

5 / 5

Progressive Disclosure

Section structure and headings are good, and the OS-onboarding guide link is well-signaled and one level deep, but this is a single ~310-line monolithic file: the naming-convention tables, CI-pipeline-coverage tables, and image-info transition discussion are all inlined with no reference files. Anchor 3 ('content that should be separate is inline'), not 4 — substantial detail (naming tables, pipeline coverage) clearly belongs in references; not 2 because structure and reference signaling are present and clear.

3 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete actions, explicit USE FOR triggers, and explicit DO NOT USE boundaries that sharply distinguish it from neighboring skills. The only weakness is slightly incomplete natural-synonym coverage (e.g. 'distro', specific pipeline file names) in the trigger terms.

DimensionReasoningScore

Specificity

'Update OS version references in Helix queue definitions to add new versions, replace EOL versions, or audit coverage against the supported-os matrix' lists multiple specific concrete actions including slot upgrades ('oldest' or 'latest'), with comprehensive coverage and no vague filler. Anchor 5; not 4 because there are no notable coverage gaps.

5 / 5

Completeness

The first sentence explicitly answers 'what' (update OS version references in Helix queue definitions — add, replace EOL, audit) and the 'USE FOR:' list explicitly answers 'when' with concrete trigger phrases. Anchor 5 ('clearly and explicitly answers both what AND when with concrete trigger phrases'); not 4 because the when-clause is fully explicit, not just present.

5 / 5

Trigger Term Quality

Natural trigger phrases are present and well-matched to user requests ('adding new OS versions to Helix queues', 'replacing EOL OS versions', 'auditing Helix coverage'), but common synonyms a user would say — 'distro', 'bump', specific file names like helix-platforms.yml — are missing. Anchor 4 ('good keyword coverage; a few natural terms missing'); not 5 because synonym-level coverage is incomplete.

4 / 5

Distinctiveness Conflict Risk

A clear niche (Helix queue OS version updates) with an explicit 'DO NOT USE FOR' clause disambiguating the two adjacent skills (dotnet-buildtools-prereqs-docker for container images, update-supported-os for supported-os.json). Anchor 5 ('clear niche with distinct triggers; minimal conflict risk'); not 4 because conflict risk is actively reduced by the boundary guidance.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 suspicious

Warning

Total

15

/

16

Passed

Repository

dotnet/runtime

Path

.github/skills/update-os-coverage/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.