Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A tight, operational playbook: checklist-driven verification contract, executable PoC patterns with negative controls, a copy-paste CVSS cheat-sheet, and a bounded failure-handling loop. The only weakness is that the deserialization pattern and a couple of negative controls are described rather than shown as runnable commands.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body never explains concepts Claude already knows — no primer on what SQLi, SSRF, or CVSS is; every line is operational (five contract fields, curl one-liners with inline success/negative comments, a 5-row vector table, a bounded retry policy). The three-line role framing ('You are the Zero-False-Positive quality gate... False positives at this stage poison everything that follows') is pipeline-specific prioritization, not padding, so the lean-and-efficient anchor fits better than 4. | 5 / 5 |
Actionability | Four of five bug classes give copy-paste-ready commands with paired success/negative patterns (e.g. 'curl -sS "http://target/ping?host=127.0.0.1;id"' with 'success: "uid=\\d"' and a negative control), and the CVSS table provides full vector strings. The deserialization pattern is prose-only ('Write a tmp sentinel file from the gadget payload... use `ls /tmp/decepticon-sentinel`') with no executable example and no explicit justification for the flexibility, and two negative examples are abbreviated ('# negative: ?file=me.png') — minor gaps matching anchor 4 rather than the fully-executable anchor 5. | 4 / 5 |
Workflow Clarity | The numbered verification contract is an explicit checklist with a built-in validation gate ('validate_finding will demote the result if the negative control also matches a success pattern'), and the failure section is a complete feedback loop: check the service is up, check payload encoding, 'Retry ONCE with a revised PoC', record 'last_failure', then 'Do NOT keep retrying. The orchestrator will re-queue.' Explicit checkpoints, error recovery, and a checklist — matches anchor 5; not 4 because no validation checkpoint is missing. | 5 / 5 |
Progressive Disclosure | A self-contained single-purpose playbook (~80 lines, no references/, scripts/, or assets/ exist) whose sections are cleanly organized and cover one task end-to-end; nothing inlined clearly belongs in a separate file — the PoC one-liners, CVSS table, and failure steps are all core to the verifier role, so there is no need for external references and no organization gap to justify 4. | 5 / 5 |
Total | 19 / 20 Passed |