Content
88%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A very strong skill body: an explicit multi-phase workflow with independent verification, coverage accounting, and machine-validated outputs, plus one of the most actionable checklists possible (exact greps, commands, expected outputs, and fix idioms). The weaknesses are mild: the body carries several verbose remediation narratives that duplicate or belong in the existing references, making it heavier than an ideal overview without adding proportionate value.
Suggestions
Move the long narrative remediations inlined in A01–A06 (open-redirect control-byte rules, VERIFY_PEER three-option ladder, Next.js headers()-merge walkthrough, paid-endpoint concurrency races) into references/checklist-details.md, keeping a one-line trigger plus the grep and a link in the body — the pattern already used for the SSRF bypass set.
Trim the framework-specific footgun blocks (Rails Devise :validatable, Rails admin-engine mounts, NextAuth v5 list) to grep lines in the body with the explanations living in references/frameworks/ playbooks, so the body stays stack-agnostic.
Where checklist bullets restate content from references/webhooks-and-parsers.md (e.g. inbound-webhook authentication), keep only the grep and a single link to avoid maintaining the same guidance in two places.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body (~460 lines) is dense with genuinely non-obvious, high-value content — framework-specific footguns ("AUTH_SECRET unset silently derives a weak dev value", "config.password_length ... only enforced when ... :validatable"), exact grep patterns, and precise fix idioms — so it mostly avoids explaining what Claude already knows. It is not a 5 because several narrative passages run long and could be tightened or pushed to references, e.g. the four-paragraph open-redirect control-byte discussion, the three-option VERIFY_PEER remediation ladder, the Next.js headers()-merge walkthrough, and the A02 paid-endpoint race explanation, some of which restates material already in checklist-details.md/webhooks-and-parsers.md. | 4 / 5 |
Actionability | Guidance is fully executable throughout: copy-paste grep commands with regexes ("AKIA[0-9A-Z]{16}", "^\s*devise\s+:", "catch \{\}"), concrete validation commands ("node <skill-dir>/references/validate-findings.mjs security-audit/findings.json"), owner-run checks with expected output ("curl -sI https://<origin>/<path> | grep -iE 'content-security-policy|...'"), and copy-ready fix patterns ("UPDATE … SET status='processing' WHERE id=? AND status='pending' RETURNING …"). Not a 4: there are no pseudocode gaps — commands, expected outputs, and fix snippets cover the common cases. | 5 / 5 |
Workflow Clarity | The 7-step workflow (Scope → Recon → Hunt → Verify → Coverage critic → Write/validate findings.json → Render) is clearly sequenced with explicit validation checkpoints and feedback loops: an independent per-finding refutation pass with a fixed verdict table, a coverage critic pass over architecture.md + coverage.json, "Fix every validation error before writing prose", and "If they disagree, fix the JSON, re-validate, and re-render". There is even a re-run/carry-forward protocol and a post-fix second-opinion pass. This matches the top anchor (explicit validation steps, error-recovery loops, checklists); it is not a 4 because no checkpoint is implicit or missing. | 5 / 5 |
Progressive Disclosure | Structure is good: every reference is one level deep, well-signaled with a stated purpose ("Hunter prompt, result shape, and the sequential fallback are in references/orchestration.md"), all cited files and anchors exist (checklist-details.md, webhooks-and-parsers.md, findings-format.md, severity-calibration.md, verification.md, recon-and-coverage.md, orchestration.md, diff-review.md, frameworks/README.md plus per-framework playbooks, validators and to-sarif.mjs), and deep detail (SSRF bypass sets, header baselines, payload sets) is correctly split out. It is not a 5 because the SKILL.md body is less an overview than a working checklist — long remediation narratives and framework footgun blocks (Rails admin-engine mounts, NextAuth v5 list, paid-endpoint races) are inlined where a link-plus-trigger-line pattern, already used elsewhere in the body, would keep the body lean. | 4 / 5 |
Total | 18 / 20 Passed |