Content
75%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A strong, highly actionable security-assessment skill: every workflow is backed by verified executable scanner commands, real bundle files, and exit-code-driven decision points. Its main weakness is token efficiency — it defines concepts Claude already knows and inlines reference-grade tables that belong alongside atlas-coverage.md — plus a merely implied fix-and-rescan loop in the workflows.
Suggestions
Cut the definitional opening sentences of each threat section ("Prompt injection occurs when...", "Model inversion attacks reconstruct training data...", "Data poisoning attacks insert malicious examples...") — Claude already knows these concepts; lead directly with the detection signatures and scoring guidance.
Move the full risk matrices (model inversion by access level, data poisoning by fine-tuning scope) and the guardrail pattern catalogs into references/ alongside atlas-coverage.md, keeping only the summary rows and pointers inline to reduce SKILL.md's footprint.
Make the remediation feedback loop explicit in Workflow 1: after "fix critical findings first", add a step to re-run the scanner and confirm exit code 0/1 before deployment is approved.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Several sections open by defining concepts Claude already knows — "Prompt injection occurs when adversarial input overrides the model's system prompt", "Model inversion attacks reconstruct training data from model outputs", "Data poisoning attacks insert malicious examples into training data" — and the ~365-line body inlines reference-style material (full risk matrices, guardrail catalogs) that could be tightened or split out. This is mostly efficient but includes unnecessary explanation, matching anchor 3; it is not lean throughout (score 4) because the definition sentences and duplicated ATLAS tables both add avoidable tokens. | 3 / 5 |
Actionability | The guidance is fully executable: copy-paste-ready scanner invocations with real flags (--target-type, --access-level, --scope, --authorized, --json, --list-patterns), a concrete test-file JSON format, and a runnable CI/CD gate snippet using jq on output fields (.overall_risk, .findings[].finding_type) that all verified present in scripts/ai_threat_scanner.py. This matches the top anchor — commands cover the common cases and are ready to run — rather than leaving minor gaps (score 4). | 5 / 5 |
Workflow Clarity | Three clearly sequenced workflows with explicit decision checkpoints driven by exit codes ("Exit code 2 = block deployment; fix critical findings first") and a CI gate that validates the report and blocks on critical risk. The fix-and-rescan feedback loop after remediation is implied by the decision text but never shown as an explicit re-run/re-validate step, so this fits anchor 4 (most checkpoints present, minor validation gaps) rather than anchor 5 (explicit feedback loops for error recovery). | 4 / 5 |
Progressive Disclosure | Structure is good: a table of contents, a clearly signaled one-level-deep reference ("Full ATLAS technique coverage reference: references/atlas-coverage.md", verified to exist and substantive), and a real scripts/ entry point, matching the actual bundle layout. Substantial reference-style content — the model-inversion and data-poisoning risk matrices and the guardrail pattern catalogs — is inlined in SKILL.md rather than split into references, which fits anchor 4 (good structure, minor organization gaps) rather than anchor 5 (content appropriately split into an overview-plus-references shape). | 4 / 5 |
Total | 16 / 20 Passed |