CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

validation

Use when Codex is already in the validation phase of a security scan or the user explicitly asks to determine whether one or more candidate security findings are valid. Do not use as the primary trigger for full PR, commit, branch, patch, or repository scans.

65

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, highly actionable phase-workflow skill: exact tool contracts, commands, paths, enums, and a complete output specification, with a verified, well-matched reference file and clear delegation of shared policy. Its weaknesses are redundancy — compact-mode and proportionality rules each restated three to four times across sections — and reliance on parent-tree references that are not verifiable within this bundle.

Suggestions

State the compact-mode rules (no per-finding reports/receipts; one nested disposition per candidate) once in the Compact Workbench-Backed Diff Mode section, and have the Workflow, Output Contract, and Hard Rules sections reference that section instead of restating them.

Consolidate the three overlapping large-repository proportionality rules (workflow step 3, and Hard Rules bullets on effort proportionality and sibling-pattern closure) into a single stated rule with its exceptions.

Break up the 40-60 word multi-clause sentences in Hard Rules (e.g., the build-failure and long-running-command rules) into shorter rule statements so each constraint is independently scannable.

DimensionReasoningScore

Conciseness

Nearly every sentence is task-specific policy (tool calls, paths, dispositions) with no padding explaining concepts Claude already knows, which keeps it above the verbose anchors. However, the same rules are restated repeatedly — compact-mode 'no per-finding reports / every candidate gets a disposition' appears in four sections (workflow step 9, Output Contract, Hard Rules, and the compact-mode section), and the large-repository proportionality rules appear in overlapping variants three times — so it could be tightened considerably. This matches 'Mostly efficient but includes some unnecessary explanation or could be tightened', not a 2, since nothing is generic filler.

3 / 5

Actionability

Guidance is fully specified to copy-paste readiness: exact tool call signatures ("list_codex_security_candidates({ scanId, cursor?, limit? })", "record_codex_security_candidate_validations({ scanId, validations: [{ candidateId, validation }] })"), exact debugger invocations (gdb: "-q -batch -ex run -ex bt -ex quit"; lldb: "-b -o run -o bt -o quit"), concrete artifact paths ("<discovery_dir>/validation_artifacts/<candidate_id>/"), exact disposition enums, and a complete output field list. Per the rubric's instruction-skill note, concrete specific guidance substitutes for code, and it is fully executable.

5 / 5

Workflow Clarity

The 9-step workflow is clearly sequenced with explicit checkpoints: a per-candidate validation rubric created before work, a condition-gated method cascade in step 3, proof-gap documentation when validation fails (step 7), and mandated per-candidate receipts in step 9. Error-recovery loops are present ('diagnose the failure enough to know whether a targeted build... can still exercise the original code'; 'check process status, recent logs... before stopping or weakening validation'), and checklists are required in both input (rubric with up to five criteria) and output ('rubric checklist with `- [x]` or `- [ ]` items'). This matches the 5 anchor; the only blemish — steps 4-5 partially restating step 3's cascade — is a redundancy issue scored under conciseness, not a sequence gap.

5 / 5

Progressive Disclosure

The one bundle reference is real, well-signaled, one level deep, and substantive: 'references/validation-guidance.md' (122 lines) contains exactly the three sections the body promises (instance-preserving validation rules, validation checklist, confidence guidance), and the body delegates storage policy and static assessment to clearly-described shared family files. Minor gaps keep it at the 4 anchor rather than 5: the `../../references/scan-artifacts.md`, `artifact-storage.md`, and `static-finding-assessment.md` citations (repeated several times) resolve outside this bundle and cannot be verified from it, and the dense 20-line Hard Rules block is more policy detail inline than a true overview layer.

4 / 5

Total

17

/

20

Passed

Description

73%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A well-scoped phase-skill description with an explicit two-condition trigger and a deliberate anti-conflict exclusion clause. Its main weakness is a thin 'what': the single stated action (determining whether candidate findings are valid) omits the concrete validation methods and outputs that would make capabilities concrete.

Suggestions

Name 2-3 concrete capabilities in the description — e.g., 'Reproduce findings with crashing PoCs, valgrind/ASan, or debugger traces, and fall back to static source-to-sink tracing when runtime reproduction is infeasible' — to raise specificity.

Add natural synonyms such as 'verify', 'confirm', or 'false positive' so the trigger matches phrasings a user would naturally say.

Briefly state the output (e.g., 'produces an evidence-backed disposition per finding') so the 'what' answers what the skill delivers, not just what it decides.

DimensionReasoningScore

Specificity

The description names the domain ("validation phase of a security scan", "candidate security findings") and one concrete action — "determine whether one or more candidate security findings are valid" — but lists no supporting concrete actions (e.g., PoC reproduction, valgrind/ASan, source-to-sink tracing). This matches the anchor 'Names domain and 1-2 concrete actions, but not comprehensive'; it is above a 2 because the stated action is concrete rather than generic, and below a 4 because no additional specific actions or outputs are named.

3 / 5

Completeness

Both parts are explicit: the 'when' is concrete and two-pronged ("Use when Codex is already in the validation phase of a security scan or the user explicitly asks to determine whether one or more candidate security findings are valid") plus a negative trigger, and the 'what' is stated clearly but thinly — a single action with no mention of validation methods or outputs. It sits between the 4 anchor ('when' could be more specific) and the 5 anchor (comprehensive what AND when), closer to 5 on 'when' but pulled down by the minimal 'what'.

4 / 5

Trigger Term Quality

Natural phrases a user in this workflow would say are present: "security scan", "validation phase", "determine whether... findings are valid", plus scan-type variations ("PR, commit, branch, patch, or repository scans") that aid routing. It falls just short of comprehensive because common synonyms such as "verify", "confirm", "triage", or "false positive" are absent.

4 / 5

Distinctiveness Conflict Risk

The description carves out a clear niche with an explicit exclusion — "Do not use as the primary trigger for full PR, commit, branch, patch, or repository scans" — which directly prevents mis-triggering for the sibling discovery/full-scan skills. This clearly matches 'Clear niche with distinct triggers; minimal conflict risk'.

5 / 5

Total

16

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

openai/plugins

Path

plugins/codex-security/skills/validation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.