CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

security-diff-scan

Review a pull request, commit, branch diff, or working-tree patch for security vulnerabilities.

59

Quality

74%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./plugins/codex-security/skills/security-diff-scan/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a dense, imperative orchestration guide with concrete tool calls, exact parameter names, command templates, explicit validation gates, and documented recovery rules. Its weaknesses are moderate redundancy, undefined sub-skill references, and reliance on external files outside the skill's own bundle.

Suggestions

Consolidate the duplicated preflight instruction (stated in both Setup and Review) into a single step to remove redundancy.

Define or point to the referenced sub-skills ($threat-model, $finding-discovery, $validation, $attack-path-analysis) so their invocations are self-explanatory.

Resolve or explain placeholders like <python_command> so the terminal-scan commands are directly executable.

DimensionReasoningScore

Conciseness

The body is dense and imperative with no explanations of concepts Claude already knows, but not every token earns its place: the preflight read instruction is duplicated in Setup ("Run the `security_diff_scan` preflight from `../../references/config-preflight.md` before reviewing files") and again in Review ("Read `../../references/config-preflight.md` before dispatching"), and the untrusted-URL rule is stated twice. Efficient with minor trimmable redundancy, matching the score-4 anchor.

4 / 5

Actionability

Guidance is mostly executable — exact tool calls with parameter names ("`start_codex_security_prompt_only_scan` once with `mode: "diff"`, `targetPath`, `scope: "."`, `diffTarget`") and full command templates for `generate_in_scope_files.py` and `launch_codex_security_mcp`. Placeholders like `<python_command>` and undefined sub-skill invocations (`$threat-model`, `$finding-discovery`, `$validation`, `$attack-path-analysis`) keep it below fully copy-paste-ready (5) while well above pseudocode-level guidance (3).

4 / 5

Workflow Clarity

A clear six-step numbered sequence (threat model → file list → discovery → validation/attack-path → record drafts → complete) with an explicit preflight validation gate, a conditional validation stage ("If candidates exist, run `$validation` once"), and error-recovery loops ("preserve the running scan and retry or hand off while recovery may still be possible"). The interleaved desktop/durable/terminal conditionals spread across Setup and Review, with some implicit checkpoints, create the minor gaps that distinguish this from the top anchor.

4 / 5

Progressive Disclosure

Detail is appropriately delegated to clearly signaled one-level references ("`../../references/config-preflight.md`", "`../../references/desktop-config-preflight.md`", "`../../references/final-report.md`") with stated purpose for each. Minor gaps: the preflight reference is duplicated rather than consolidated, the `$`-prefixed sub-skills are invoked without any pointer to where they are defined, and the referenced paths live outside the skill's own directory with no local references/ bundle present to verify them.

4 / 5

Total

16

/

20

Passed

Description

61%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise, in third person, and clear about what the skill does and on which input types, with strong natural trigger keywords. Its main gaps are the complete absence of when-to-use trigger guidance and a single action verb, which hold completeness and specificity at mid-level.

Suggestions

Add an explicit trigger clause, e.g. "Use when the user asks for a security review, vulnerability scan, or security audit of a pull request, commit, or diff."

Name one or two more concrete actions (e.g., "identifies exploitable vulnerabilities and produces a findings report with SARIF output") to broaden capability coverage beyond the single "review" verb.

Include common synonyms such as "security review", "security audit", or "vulnerability scan" so more natural user phrasings match.

DimensionReasoningScore

Specificity

Names one concrete action — "Review ... for security vulnerabilities" — grounded by four input types ("pull request, commit, branch diff, or working-tree patch"), matching the anchor for a clear domain with 1-2 concrete actions. It does not list several distinct actions, so it sits below the "lists several specific actions" anchor (4) and clearly above the domain-only "Processes PDF files" anchor (2).

3 / 5

Completeness

"Review a pull request, commit, branch diff, or working-tree patch for security vulnerabilities" clearly answers "what", but there is no "Use when..." clause or equivalent explicit trigger guidance, which caps completeness at 3 per the judging guidelines. This matches the anchor "has a clear 'what' but 'when' is missing or only weakly implied".

3 / 5

Trigger Term Quality

"pull request", "commit", "branch diff", and "security vulnerabilities" are phrases a user would naturally say when needing this skill, giving good keyword coverage. Common synonyms such as "security review", "security audit", or "vulnerability scan" are missing, so it falls short of the comprehensive-synonyms anchor (5) while exceeding "some relevant keywords" (3).

4 / 5

Distinctiveness Conflict Risk

The security-vulnerability focus on diffs/PRs carves a mostly distinct niche, but the opening "Review a pull request" could also match a general code-review skill, fitting "mostly distinct; minor overlap risk with closely related skills". It is not the fully distinct anchor (5) because a plain "review this PR" request lacks a differentiator until the trailing security clause.

4 / 5

Total

14

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

openai/plugins

Path

plugins/codex-security/skills/security-diff-scan/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.