Content
78%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A highly actionable, well-structured runbook: every workflow step is backed by executable Volatility 3 commands, detection guidance is concrete (specific IoCs, protection flags, parent-process expectations), and the scenario with pitfalls adds real judgment value. The two notable weaknesses are the disconnect between SKILL.md and the provided bundle files (no navigation to references/api-reference.md or scripts/agent.py) and the absence of explicit validation/error-recovery checkpoints in the workflow.
Suggestions
Add a short automation section pointing to the existing bundle so it is discoverable, e.g. "For automated bulk analysis, run scripts/agent.py (see references/api-reference.md for functions and CLI usage)" — this directly addresses the un-signaled references.
Trim the Key Concepts and Tools & Systems sections to only entries that aid interpretation of plugin output (e.g. keep VAD/EPROCESS and the PAGE_EXECUTE_READWRITE flag; drop generic definitions like process injection and one-line tool descriptions).
Insert an explicit validation checkpoint after Step 1 (recompute and compare the dump's SHA-256 before analysis begins) and a brief recovery path for the most common failure (missing symbol tables: "vol -f dump.raw windows.info fails → download symbols or set the symbol server") to add feedback loops to the workflow.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is command-dense with tight inline commentary (e.g. "# Compare pslist vs psscan to find hidden processes") and no padded prose, but the Key Concepts table re-explains concepts Claude largely knows ("Process Injection | Technique where malware inserts code into a legitimate process's memory space...") and the Tools & Systems section re-describes well-known tools (YARA, Volatility). Minor trimming opportunities keep this below anchor 5. | 4 / 5 |
Actionability | Commands are copy-paste ready and cover the common cases end-to-end: acquisition ("winpmem_mini_x64.exe output.raw", "./avml output.lime"), analysis ("vol -f memory.raw windows.pslist", "windows.malfind", "windows.yarascan --yara-file malware_rules.yar"), extraction ("windows.hashdump", "windows.dumpfiles --pid 3847"), and reporting. The only un-executed mention is CobaltStrikeParser in the scenario, which is an enrichment step rather than a gap in core guidance. | 5 / 5 |
Workflow Clarity | Seven clearly sequenced steps (acquire → identify OS → processes → network → injection → credentials → report) with analytic cross-checks (pslist vs psscan for hidden processes, YARA confirmation of malfind findings, cross-referencing netscan with the process tree). Not anchor 5: there is no explicit post-acquisition integrity validation (verify the dump's SHA-256 before analysis) and no error-recovery feedback loops (e.g. what to do when symbol tables fail to resolve). | 4 / 5 |
Progressive Disclosure | The body itself is well-sectioned (When to Use, Prerequisites, Workflow, Scenarios, Output Format), but the skill ships a bundle — references/api-reference.md and scripts/agent.py — that is never referenced or signaled anywhere in SKILL.md, leaving the automation agent and its API documentation undiscoverable. This matches anchor 3 ("references present but not clearly signaled") rather than anchor 4's "references mostly clear". | 3 / 5 |
Total | 16 / 20 Passed |