CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

semgrep-rule-creator

Creates custom Semgrep rules for detecting security vulnerabilities, bug patterns, and code patterns. Use when writing Semgrep rules or building custom static analysis detections.

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, strongly actionable body: copy-paste Quick Start, strict test-first workflow with explicit validation gates, anti-patterns shown as BAD/GOOD code, and a clean split of detail into two one-level-deep reference files. The only weaknesses are mild over-explanation in the taint-mode rationale and a workflow checklist whose step details are delegated to workflow.md.

DimensionReasoningScore

Conciseness

Sections are dense and operational (when/when-not, rationalizations to reject, anti-patterns with code, strictness rules) with no explanation of concepts Claude already knows, e.g. no preamble about what Semgrep is. Scored 4 not 5 because passages like "Why prioritize taint mode?" re-argue a point already stated as a rule and could be trimmed.

4 / 5

Actionability

Quick Start provides copy-paste-ready YAML, a matching test file, and the exact command `semgrep --test --config <rule-id>.yaml <rule-id>.<ext>`, plus a concrete output structure, a tracked checklist, and seven specific documentation URLs. This covers the common case fully executably, matching the 5 anchor rather than 4.

5 / 5

Workflow Clarity

A 7-step tracked checklist with explicit validation requirements ("100% test pass is required", iterate until all tests pass, Final Run) satisfies the validation expectation, so no cap applies. Scored 4 rather than 5 because the per-step semantics live in workflow.md, leaving the in-body sequence as labeled steps rather than a fully specified sequence with inline feedback loops.

4 / 5

Progressive Disclosure

The body keeps a quick start inline while pushing commands/operators to references/quick-reference.md and the detailed workflow to references/workflow.md, both clearly signaled via {baseDir} links that resolve to real files one level deep (workflow.md links only back to SKILL.md and its sibling reference). This matches the 5 anchor: clear overview with well-signaled one-level-deep references and easy navigation.

5 / 5

Total

18

/

20

Passed

Description

73%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A concise, third-person description that clearly states both what the skill does and when to use it, anchored to the distinct Semgrep niche. Its main limitation is a single-action view of the skill (rule creation) that under-sells the testing/iteration workflow and omits trigger synonyms like taint analysis.

Suggestions

Mention taint mode in the description since it is the skill's prioritized approach and a natural trigger phrase users would say.

Add one more concrete capability (e.g., testing rules with semgrep --test) so the what-clause reflects the full create-and-validate workflow.

DimensionReasoningScore

Specificity

"Creates custom Semgrep rules for detecting security vulnerabilities, bug patterns, and code patterns" names the domain and one concrete action with three detection targets, but offers no other actions (testing, taint mode, validation). Matches the 3 anchor (domain plus 1-2 concrete actions, not comprehensive) better than 4, which expects several distinct actions listed.

3 / 5

Completeness

A clear what ("Creates custom Semgrep rules for detecting...") is paired with an explicit when ("Use when writing Semgrep rules or building custom static analysis detections"). Not 5 because the when-clause is narrower than the anchor's fuller concrete trigger set, omitting scenarios like taint-mode rules or rule testing.

4 / 5

Trigger Term Quality

"Semgrep rules", "security vulnerabilities", "bug patterns", and "static analysis detections" are phrases users naturally say, giving good keyword coverage. Not 5 because common synonyms such as "taint analysis", "SAST", or "linting" are absent.

4 / 5

Distinctiveness Conflict Risk

"Semgrep" names a distinct tool niche with distinct triggers, so conflict risk is minimal. The only mild overlap is with a generic static-analysis skill via "custom static analysis detections", but the tool name dominates, matching the 5 anchor rather than 4.

5 / 5

Total

16

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 missing, 2 deeper-than-1-level

Warning

Total

15

/

16

Passed

Repository

trailofbits/skills

Path

plugins/semgrep-rule-creator/skills/semgrep-rule-creator/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.