Content
75%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured, actionable threat-profiling workflow with concrete schemas, technique IDs, and real reference files, held just below top marks by mild over-explanation and an implicit rather than explicit validation feedback loop.
Suggestions
Make the Step 3→Step 5 validation loop explicit (e.g. 'If a planned TTP conflicts with RoE, prune it and re-confirm the kill chain before writing') to strengthen the feedback loop.
Trim the opening framing sentence and any restated rationale to tighten token efficiency.
Consolidate the emulation-playbook references into a short bulleted reference list so navigation paths are scannable at a glance.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is mostly efficient — tables, a JSON schema, and concrete MITRE IDs carry the load — with only minor over-explanation (e.g. the opening 'Without a clear profile, the engagement devolves into arbitrary tool usage...' framing) that could be trimmed. | 4 / 5 |
Actionability | Guidance is largely executable: a copy-paste-ready ThreatProfile JSON block, specific MITRE technique IDs per RoE constraint, and concrete load_skill() paths, with only minor gaps where steps are guidance rather than runnable commands. | 4 / 5 |
Workflow Clarity | A clear 5-step sequence with an explicit validation checkpoint (Step 3: Validate Against RoE) and a feedback reference (Step 5 prunes RoE-forbidden techniques before writing); minor gap is that the validation→fix→retry loop is implicit rather than an explicit re-check loop. | 4 / 5 |
Progressive Disclosure | Overview content is kept inline while detail is pushed to clearly signaled, one-level-deep references that exist as real files ('references/adversary-archetypes.md', 'references/apt-groups.md', 'emulation/<actor>/SKILL.md'); minor organization gap is that the emulation catalog reference is described in prose rather than a tidy reference list. | 4 / 5 |
Total | 16 / 20 Passed |