Content
100%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary lean, dense, fully executable hunting playbook: every section carries non-obvious practitioner knowledge (scanner blind spots like Django raw/extra, dynamic identifier sinks ORMs don't parameterize, second-order taint across the DB boundary), with concrete commands, ready PoC payloads, and an explicit validation contract including negative controls and a demote rule.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense practitioner reference material: a sink/safe-API table by language, terse audit commands ("semgrep --config p/sql-injection …", "grep -rE 'ORDER BY.*\$|LIMIT.*\$|GROUP BY.*\$' …"), and a compact CVSS table. It never explains what SQL injection is or how ORMs work — it assumes Claude's competence and every section earns its place, matching anchor 5 ("Lean and efficient; every token earns its place"). The one flourish ("Classic, still the king.") is a single clause flagging relevance, not padding. Not 4 because there is no over-explanation to trim. | 5 / 5 |
Actionability | Fully executable, copy-paste-ready guidance throughout: a concrete semgrep command with SARIF output paths, targeted grep regexes for scanner blind spots ("\.raw\(|\.extra\(", dynamic ORDER BY/LIMIT/GROUP BY), ready curl PoC payloads with expected success signals ("response time > 5s", "mysql error with version string reflected"), and a validate_finding contract with concrete success/negative patterns — matching anchor 5 ("Fully executable; copy-paste ready code or commands; specific examples cover the common cases"). Not 4 because there are no missing key details for the common cases. | 5 / 5 |
Workflow Clarity | Numbered sections form a coherent sequence: sources (§1) → sinks (§2) → audit steps (§3) → special subclasses (§4–6) → PoC validation (§7) → scoring (§8) → chaining (§9). Validation is explicit with a feedback rule: "negative_command: same URL with q=1 (no payload)" plus "if present without payload, it's unrelated noise — demote" — a negative-control checkpoint with a demote action, matching anchor 5 ("Clear sequence with explicit validation steps; feedback loops for error recovery"). Not 4 because the checkpoints are explicit rather than only "most" present. | 5 / 5 |
Progressive Disclosure | No bundle files exist (references/, scripts/, assets/ are all absent) and none are needed: the ~110-line body is core playbook content (sink tables, audit commands, validation contract, CVSS defaults) appropriately kept inline at this size, organized into nine clearly headed, navigable sections — matching the well-organized self-contained top anchor. Not 4 because there are no organization gaps: sections are cleanly separated, clearly titled, and nothing that belongs in a separate file is inlined. | 5 / 5 |
Total | 20 / 20 Passed |