Content
77%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body delivers an exceptionally concrete, well-sequenced novelty-verification workflow with executable MCP calls, a report template, and real validation gates. Its weaknesses are efficiency (duplicated rationale, inlined orchestration boilerplate, hard-coded years/venues that will age) and structure (heavy reliance on shared-reference files and helper scripts that are not present in this bundle).
Suggestions
State the two-failure rationale once — keep it in the verdict-limits block (which must be copied verbatim anyway) and drop the near-duplicate phrasing in Important Rules.
Move dated content (ICLR/NeurIPS/ICML year lists, 'year filters for 2024-2026', 'most recent 6 months of arXiv') into a small maintenance note or replace with relative phrasing like 'the current and previous year's major venues' so the skill does not silently go stale.
Either ship the shared-reference files and helper scripts (verify_papers.py, save_trace.sh, reviewer_route.py) inside the bundle (e.g., references/ and scripts/) or reduce the body's dependence on them — currently several instructions resolve to paths that do not exist alongside the skill.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is mostly directive and dense, but includes clear tightening opportunities: the "Two failures waste months equally" rationale is stated twice (verbatim in the verdict-limits block and again in Important Rules), the reviewer-routing preamble is orchestration boilerplate peripheral to novelty checking, and time-sensitive content ("ICLR 2025/2026, NeurIPS 2025", "year filters for 2024-2026") is not isolated in a dated section. It is above the noticeably-verbose anchor because most tokens do earn their place, but below the efficient anchor. | 3 / 5 |
Actionability | The guidance is fully executable: a copy-paste-ready MCP invocation with model and reasoning-effort config, a specified dossier file with its required contents, a verbatim block to forward to the reviewer, per-claim search tactics (3 query formulations, year filters, named venues), a complete markdown report template, and a concrete paper-verification helper with an explicit fallback policy (Policy D1). This matches the copy-paste-ready anchor covering the common cases. | 5 / 5 |
Workflow Clarity | The process is a clearly sequenced four-phase workflow (extract claims → multi-source search → cross-model verification → structured report) with explicit validation checkpoints: abstract reading for candidate overlaps, mandatory pre-search verification of every prior-work paper via verify_papers.py, a degraded-output fallback when the helper fails, and REVIEW_UNAVAILABLE handling for the reviewer slot. The calibration limits bound the verdict step and permissive-tie guidance resolves ambiguity, matching the explicit-validation-with-feedback anchor. The workflow is read-only research, so the destructive/batch cap does not apply. | 5 / 5 |
Progressive Disclosure | The skill is a single SKILL.md with no references/, scripts/, or assets/ bundle, yet the body leans on external files (../shared-references/reviewer-backends.md, integration-contract.md, citation-discipline.md, review-tracing.md) and helper scripts (verify_papers.py, reviewer_route.py, save_trace.sh) none of which exist in the bundle, so those links dangle; the routing preamble, citation-policy summary, and tracing policy are inlined here. References are clearly labeled with sections and are one conceptual level deep, but the unresolvable paths and inlined orchestration material keep this at the some-structure-could-be-better-organized anchor rather than the good-structure anchor. | 3 / 5 |
Total | 16 / 20 Passed |