Content
90%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exceptionally dense, executable technique reference: concrete recon commands, per-ecosystem payload diffs, and a safety decision gate with almost no wasted tokens. The main gaps are the absence of an explicit numbered end-to-end workflow with a beacon-verification feedback loop, and a monolithic single-file structure that could push per-ecosystem examples into references/.
Suggestions
Add a short numbered operational sequence (recon → confirm scope → select vector → deploy beacon-only PoC → verify beacon received → close and delete fork) with an explicit verification checkpoint before cleanup.
Split the per-ecosystem payload examples (Gradle/Maven, Danger/pre-commit, setup.py, test fixtures) into a references/ file with one-level-deep links from SKILL.md, keeping the main file as a lean overview.
Fold the Tools table entries for zizmor/octoscan/actionlint into the recon section as concrete commands (e.g., the exact zizmor invocation) so the tool guidance is directly runnable.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and code-first: every section is either a compact command block, a payload diff, or a two-column table, and the prose adds only non-obvious domain knowledge (the D-PPE/I-PPE taxonomy, why pull_request_target + PR-head checkout is privileged). It is not 4 because nothing reads as over-explanation to trim; the CVE/date mentions ("CVE-2025-30066", "Mar 2025") are precedent citations, not date-conditional instructions. | 5 / 5 |
Actionability | Guidance is fully executable: copy-paste recon greps and gh api commands, concrete PR-diff payloads per ecosystem (package.json postinstall, Makefile target, build.gradle doFirst, pom.xml plugin, Dangerfile, pre-commit repo, setup.py), and a named tool table (gato/gato-x, actionlint, zizmor, octoscan). It is not 4 because the examples are complete and cover the common cases; the <COLLAB>/<REPO> placeholders are parameters, not pseudocode. | 5 / 5 |
Workflow Clarity | A clear implicit sequence runs Recon → choose D-PPE or I-PPE vector → payload → Decision gate, with a numbered recon checklist (trigger greps, fork/permission checks) and a Decision gate acting as a safety checklist (beacon-only PoC, labeled research fork, close+delete after capture). It is not 5 because there is no explicit end-to-end numbered workflow or feedback loop (e.g., verify the beacon was received before cleanup); not 3 because validation checkpoints are present via the recon gates and Decision gate. | 4 / 5 |
Progressive Disclosure | The body is well-sectioned with navigable headers (Recon, Direct PPE, Indirect PPE, pull_request_target, Chains, Tools, Detection, Decision gate) and cross-skill references clearly signaled in the Chains table (cicd-secrets-exfil/SKILL.md, self-hosted-runner-abuse/SKILL.md); no bundle files exist, so inline placement is the only option. It is not 5 because at ~180 lines the per-ecosystem payload examples are candidates for one-level-deep references/ files that would keep SKILL.md a leaner overview. | 4 / 5 |
Total | 18 / 20 Passed |