Content
68%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is a well-structured, concise catalog of output-exfiltration techniques with concrete probe patterns and mitigations, scoring well on conciseness, actionability, and organization. Its main weakness is workflow clarity: it describes techniques rather than sequencing a validated test workflow with checkpoints.
Suggestions
Add an explicit ordered probing workflow with validation checkpoints (e.g. 1. deploy Collaborator endpoint, 2. inject probe, 3. confirm outbound callback, 4. record finding) including a validate->retry feedback loop for batch/destructive runs.
For each technique, pair the description with a concrete, runnable probe snippet (request payload or tool-call example) instead of prose-only recipes.
Consider splitting the per-technique detail into a one-level-deep reference file (e.g. techniques.md) so SKILL.md stays a lean overview with clear navigation.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and efficient, listing techniques and mitigations without explaining concepts Claude already knows; only a few one-line glosses could be trimmed, keeping it above the mostly-efficient midpoint but short of fully lean. | 4 / 5 |
Actionability | It gives concrete technique recipes and an executable-looking probe-pattern YAML block with specific plugin ids and test counts, but several techniques are described rather than given as runnable steps and the code is config rather than executable attack code, leaving minor gaps. | 4 / 5 |
Workflow Clarity | The probe pattern implies a loose sequence and there is a detection-signals section, but there is no explicit multi-step workflow with validation checkpoints or a validate->fix->retry feedback loop for these destructive/batch probing operations, which the rubric caps at 3. | 3 / 5 |
Progressive Disclosure | Content is well-organized into clearly headed sections (Techniques, Probe pattern, Detection signals, Severity, Defender, Cross-references) with no nested or buried references, and no bundle files exist to verify; not a 5 only because it is a single flat file rather than an overview pointing to one-level-deep detail references. | 4 / 5 |
Total | 15 / 20 Passed |