Content
77%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is an operationally rich, highly executable playbook with an exemplary gated workflow, explicit validation criteria, and feedback loops — clearly written by someone who has burned cycles on these challenges. Its weaknesses are inlined per-attack content that belongs in one-level-deep reference files and two sections (ECB cut-and-paste, prefix/suffix recovery) that stop at prose or comment steps instead of runnable code.
Suggestions
Split each attack family (padding oracle, ECB, HMAC/JWT) into references/<attack>.md files and keep SKILL.md to recognition signals, the confirm-oracle gate, and the anti-patterns/verification checklists, with clearly signaled links — this moves progressive disclosure from inline monolith to one-level-deep navigation.
Replace the ECB cut-and-paste comment list and the prefix/suffix recovery prose steps with runnable Python snippets (block splicing, block-size detection loop) matching the quality of the Vaudenay harness.
Trim the conceptual one-line intros that restate known crypto mechanics (CBC bit-flip propagation, ECB block equality, how Vaudenay works) and keep only the environment-specific guidance.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The bulk of the body is hard-won operational knowledge Claude does not have — the confirm-oracle gate, '500s ARE valid-pad signals', the ~32 max_workers throttle threshold, atomic-pipeline and single-process discipline — and code blocks are dense with earning tokens. It sits at level 4 rather than 5 because brief conceptual intros restate known material (e.g. 'Decrypt a CBC ciphertext one byte at a time by manipulating the previous block's bytes...', the CBC bit-flipping mechanics explanation, and ECB pattern-detection prose) that could be trimmed. | 4 / 5 |
Actionability | The confirm-oracle gate and the full Vaudenay harness are copy-paste-ready executable scripts with explicit placeholders, and the JWT forgery, bit-flip, and hashpump examples are runnable. It falls short of level 5 because the ECB cut-and-paste section is only a numbered comment list ('# 1. Register a user...') and prefix/suffix recovery is prose steps without runnable code — minor but real gaps in executable coverage. | 4 / 5 |
Workflow Clarity | The sequence is explicit and gated: Step 0 key discovery → recognition signals → confirm-oracle gate with hard pass/fail criteria and a defined fail path ('hand back to recon') → per-attack walkthroughs → a dedicated Verification section with per-attack acceptance criteria. Feedback loops are explicit (garbage first block → 'KILL and re-derive'; oracle predicate re-check), and the Anti-Patterns section acts as a checklist, matching the score-5 anchor. | 5 / 5 |
Progressive Disclosure | No bundle files exist and the entire skill is one ~330-line file. Section headers are clear, but five self-contained attack walkthroughs (Vaudenay ~70 lines, ECB, HMAC/JWT, anti-patterns, verification) are inlined where the main file could hold recognition signals plus the gate and point one level deep to per-attack reference files — matching level 3 ('content that should be separate is inline'). It does not reach level 4 because the inlining is more than a minor organization gap for a skill of this breadth. | 3 / 5 |
Total | 16 / 20 Passed |