Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured, strongly actionable body: copy-paste Quick Start, strict test-first workflow with explicit validation gates, anti-patterns shown as BAD/GOOD code, and a clean split of detail into two one-level-deep reference files. The only weaknesses are mild over-explanation in the taint-mode rationale and a workflow checklist whose step details are delegated to workflow.md.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Sections are dense and operational (when/when-not, rationalizations to reject, anti-patterns with code, strictness rules) with no explanation of concepts Claude already knows, e.g. no preamble about what Semgrep is. Scored 4 not 5 because passages like "Why prioritize taint mode?" re-argue a point already stated as a rule and could be trimmed. | 4 / 5 |
Actionability | Quick Start provides copy-paste-ready YAML, a matching test file, and the exact command `semgrep --test --config <rule-id>.yaml <rule-id>.<ext>`, plus a concrete output structure, a tracked checklist, and seven specific documentation URLs. This covers the common case fully executably, matching the 5 anchor rather than 4. | 5 / 5 |
Workflow Clarity | A 7-step tracked checklist with explicit validation requirements ("100% test pass is required", iterate until all tests pass, Final Run) satisfies the validation expectation, so no cap applies. Scored 4 rather than 5 because the per-step semantics live in workflow.md, leaving the in-body sequence as labeled steps rather than a fully specified sequence with inline feedback loops. | 4 / 5 |
Progressive Disclosure | The body keeps a quick start inline while pushing commands/operators to references/quick-reference.md and the detailed workflow to references/workflow.md, both clearly signaled via {baseDir} links that resolve to real files one level deep (workflow.md links only back to SKILL.md and its sibling reference). This matches the 5 anchor: clear overview with well-signaled one-level-deep references and easy navigation. | 5 / 5 |
Total | 18 / 20 Passed |