CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

assess-patch-risk

Assess an immutable patch artifact's program impact, regression risk, and auto-merge eligibility. Use for generated patch files, provider pull-request diffs, or commit ranges when reviewers need evidence about affected runtime paths, contracts, tests, and recoverability. This skill is read-only and does not generate, edit, apply, push, or merge the patch.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered instruction-only skill body: an unambiguous sequenced workflow with validation and stop conditions, appropriate offloading of rating detail and storage policy to one-level-deep references, and mandated executable validation. The main weaknesses are mild — over-explained Windows environment handling and placeholder rather than example invocations.

Suggestions

Trim the Windows validation commentary to the invocation plus the UNC and stdin notes; the justification of why the pattern avoids CMD expansion pitfalls can be shortened without losing executability.

Add one concrete example invocation (with a resolved plugin root and assessment path) and a short sample report alongside the JSON schema reference so the output contract is copy-paste ready.

Split the dense step 7 ("Try to falsify safety") into a short lead sentence plus its boundary rules as bullets; the current single paragraph buries several distinct policies.

DimensionReasoningScore

Conciseness

The body is dense and instructive with no padding or explanation of concepts Claude already knows — every workflow step adds skill-specific policy (identity binding, trust reclassification, coverage distinctions). It falls to anchor 4 rather than 5 because sections like the Windows env-var commentary ("These two environment variables are temporary values in the calling shell, not application settings... CMD expands the references once, preserving literal % and ! in the paths") explain more than the command itself needs, and step 7 packs several distinct policies into one paragraph that could be trimmed or split.

4 / 5

Actionability

Guidance is concrete and specific: a 10-step procedure with exact stop conditions, a fixed recommendation/label vocabulary, an external JSON schema for the output contract, and literal validation commands for both POSIX and Windows. It sits at anchor 4 rather than 5 because the commands are placeholder-parameterized (`<plugin-root>`, `<assessment.json>`) with resolution guidance rather than copy-paste-ready literal examples, and no worked example invocation or report is shown.

4 / 5

Workflow Clarity

The 10-step workflow is clearly sequenced with explicit checkpoints: step 1 defines stop conditions ("stop with hold_for_evidence if the artifact is incomplete or its identity changes"), step 10 bounds unknowns ("at most three concrete actions, the evidence each action seeks"), and the Output section mandates validation before returning with a feedback loop ("Correct structural or invariant errors by revisiting the evidence; never change a recommendation merely to make validation pass"). This matches anchor 5's clear sequence with explicit validation and error-recovery loops; anchor 4 would require missing checkpoints, and the destructive/batch cap does not apply since the skill is read-only and validation is present.

5 / 5

Progressive Disclosure

The body is a clear overview — concept definitions, workflow, recommendation taxonomy, output contract, validation, hard rules — with detailed rating anchors correctly split into references/risk-rubric.md (which exists in the bundle) and storage policy in ../../references/artifact-storage.md, both one level deep and clearly signaled ("Read [references/risk-rubric.md](references/risk-rubric.md) before assigning ratings"). The plugin-root-relative ../../ paths are self-consistently explained ("This skill lives at <plugin-root>/skills/assess-patch-risk/SKILL.md, so <plugin-root> is two directories up"), so navigation is unambiguous, matching anchor 5.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capabilities, an explicit Use-for trigger clause, and a clear read-only scope statement. The only gap is a few natural synonyms and file extensions (.patch, .diff, PR review) in the trigger vocabulary.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities — "Assess an immutable patch artifact's program impact, regression risk, and auto-merge eligibility" — and enumerates exact input types ("generated patch files, provider pull-request diffs, or commit ranges") plus explicit non-goals ("does not generate, edit, apply, push, or merge the patch"). Coverage is comprehensive for its niche with no vague filler, matching the anchor for multiple specific concrete actions; anchor 4 falls short because there are no meaningful gaps in capability coverage.

5 / 5

Completeness

The "what" is explicit in the first sentence ("Assess... program impact, regression risk, and auto-merge eligibility") and the "when" is an explicit Use-for clause with concrete triggers ("Use for generated patch files, provider pull-request diffs, or commit ranges when reviewers need evidence about affected runtime paths, contracts, tests, and recoverability"). Both are clearly and concretely stated, matching anchor 5; anchor 4 would require the when-clause to be less explicit than it is.

5 / 5

Trigger Term Quality

Natural user phrasing is well covered: "patch", "pull-request diffs", "commit ranges", "regression risk", "merge", "reviewers". However, common synonyms and extensions a user might actually say — ".patch", ".diff", "PR review", "code review" — are absent, so it fits anchor 4 (good keyword coverage, a few natural terms missing) rather than anchor 5 (comprehensive coverage including synonyms and file extensions).

4 / 5

Distinctiveness Conflict Risk

The description carves a clear niche — evidence-based risk and auto-merge eligibility assessment of immutable patch artifacts — with triggers (patch files, PR diffs, commit ranges, merge eligibility) distinct from generic code-review or document skills, and the read-only boundary statement further disambiguates it. It matches anchor 5 (clear niche with distinct triggers, minimal conflict risk); overlap with a general review skill is possible but the merge-eligibility framing keeps it minor.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 1 suspicious

Warning

Total

15

/

16

Passed

Repository

openai/plugins

Path

plugins/codex-security/skills/assess-patch-risk/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.