Content
75%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-built instruction skill: a clear four-phase pipeline, concrete tooling and quotas, and a calibrated verdict framework that guards against both false-positive and false-negative novelty calls. Its weaknesses are modest — duplicated calibration rules, meta-overlay commentary, and missing failure-path handling in the workflow.
Suggestions
Deduplicate the calibration guidance: the 'two failures waste months equally' framing and the permissiveness rule appear in both the NOVELTY VERDICT LIMITS block and Important Rules — keep them only where the reviewer must see them and reference the block from Important Rules.
Add a short failure-path note in Phase C (reviewer job errors, timeout, or empty Phase B results) so the workflow has an explicit recovery branch rather than an implicit happy path.
Make Phase B's 'Known paper databases' step actionable by giving concrete lookup commands or URLs (e.g., arXiv listing URLs or venue accepted-paper pages) instead of venue names alone.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body assumes Claude's competence (no explanation of what arXiv or literature review is) and every section drives action, but there is real duplication: 'Two failures waste months equally' appears nearly verbatim in both the verdict limits block and Important Rules, and the Codex/Gemini overlay notes at the top are meta-commentary unrelated to the task. This fits 'efficient; minor instances that could be trimmed' rather than the lean 5 anchor. | 4 / 5 |
Actionability | Guidance is mostly executable: named MCP tools with jobId polling semantics ('mcp__gemini-review__review_start', 'poll mcp__gemini-review__review_status ... until done=true'), concrete search quotas ('Try at least 3 different query formulations per claim', year filters 2024-2026), and a copy-ready report template. It stops short of 5 because Phase B's 'Known paper databases: Check against' gives venues but no URLs or lookup method, and the Phase C call is sketched as a YAML-ish prompt block rather than an actual tool invocation. | 4 / 5 |
Workflow Clarity | Phases A-D are cleanly sequenced with inputs and outputs at each stage, and Phase C's cross-model verification plus the verbatim verdict limits act as an explicit checkpoint on Phase B's search results. It misses 5 because there are no error-recovery or edge-case branches (what to do when no papers surface, when the reviewer job fails or times out, or when claims are fewer than 3). | 4 / 5 |
Progressive Disclosure | The body is well-organized with clear section headers (Constants, Instructions by phase, verdict limits, report template, Important Rules) and no phantom or buried references — it correctly references no bundle files, and none exist. The ~25-line verdict limits block and the report template are needed on every run, so inline placement is appropriate; minor organization gaps (e.g., Important Rules mixing calibration guidance with scope rules) keep it at 4 rather than 5. | 4 / 5 |
Total | 16 / 20 Passed |