Content
63%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A thorough, actionable audit procedure with a clear 7-step sequence, concrete templates, decision tables, and appropriate human-approval gates for destructive edits. Its weaknesses are verbosity from restating the same invariants across sections, a dependence on external shared-reference files that are not present in the bundle, and inlining of large schemas that would sit better in reference files.
Suggestions
State each invariant once in 'Key Rules' and reference it from the workflow sections — e.g., the 'uncited entries never block the verdict' rule currently appears in ~7 places and the soft-only bib-freeze invariant in ~5; consolidating them would cut substantial length without losing behavior.
Move the full artifact JSON schema and the extended soft-only mode specification (translation table, augmented JSON/MD examples) into a bundle file such as references/submission-artifact.md, keeping SKILL.md as a lean overview — this also fixes the dependence on 'shared-references/assurance-contract.md', which does not exist in the skill's bundle.
Make Step 2 executable as written: give a concrete extraction command (e.g., a grep/Python one-liner for \cite{...} with file:line and surrounding sentence) instead of 'Record the cite key...', and either bundle or inline the reviewer-routing resolution currently delegated to the missing reviewer_route.py.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The core workflow (Steps 1-7) is efficient and procedural, but the same invariants are restated many times: 'uncited entries never block the verdict' appears in ~7 places (Step 2, the Step 5 template, the opt-in section, the fallback, Key Rules, Submission Artifact Emission) and the soft-only bib-freeze invariant in ~5, plus dense org-routing blockquotes at the top. This fits the 3 anchor ('mostly efficient but includes some unnecessary explanation or could be tightened') — the padding is real but concentrated in repeated restatements rather than explanations of concepts Claude already knows, so it does not drop to 2's 'several unnecessary explanations or padded sections' as the dominant character. | 3 / 5 |
Actionability | Concrete, copy-adaptable guidance throughout: a full spawn_agent message template with per-axis output contracts, a literal `latexmk -C && latexmk -pdf -interaction=nonstopmode main.tex` command, worked JSON ledger and MD report examples, and explicit path/hash conventions. Falls short of 5 because Step 2's extraction ('Record the cite key... Record the surrounding sentence') lacks a concrete grep/parser command, and reviewer routing defers to `reviewer_route.py` and other files not present in the bundle. | 4 / 5 |
Workflow Clarity | Seven clearly sequenced steps with an interactive approval gate (Step 6: 'REPLACE and REMOVE always require human approval'), a recompile-and-verify validation checkpoint (Step 7: confirm 'No new Citation undefined warnings'), a verdict decision table, and explicit fallbacks (bib enumeration failure, reviewer error). It misses 5 because there is no error-recovery loop after Step 7 (what to do if new undefined citations appear) and the per-entry aggregation rules are spread across multiple cross-referenced sections. | 4 / 5 |
Progressive Disclosure | Section structure and internal cross-references are consistent, but the body leans on ~8 external files ('shared-references/assurance-contract.md', 'reviewer-tracing.md', 'reviewer_route.py', 'save_trace.sh', 'verify_paper_audits.sh', '../shared-references/reviewer-backends.md') none of which exist in the skill's bundle (references/, scripts/, assets/ are absent), so the references cannot be resolved from the skill itself. Large contract material (the full artifact JSON schema, the ~90-line soft-only specification) is inlined monolithically in the ~500-line SKILL.md. This lands at the 3 anchor ('content that should be separate is inline') rather than 4, since the unverifiable external references are more than a minor organization gap; it stays above 2 because structure and signaling are good. | 3 / 5 |
Total | 14 / 20 Passed |