Content
67%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A dense, highly actionable skill with a well-sequenced workflow, concrete templates, and explicit error handling. Its weaknesses are duplication of venue/page-budget rules, an opaque reviewer-routing preamble, and — most seriously — total dependence on shared-reference and helper files that are not present in the bundle, leaving all of its progressive-disclosure links broken.
Suggestions
Ship the referenced files (shared-references/*.md and tools/extract_paper_style.py) in the bundle, or inline the essential content — every cross-reference from SKILL.md is currently a broken path.
Deduplicate the venue and MAX_PAGES rules: 'Constants' and 'Key Rules' both state the IEEE references-counted rule and venue citation norms; state each rule once and cross-reference it.
Rewrite the 'Before each reviewer slot' preamble as a short numbered procedure or move it into the (currently missing) reviewer-backends.md file it points to; its current compressed phrasing ('resolve invocation → .aris/reviewer.json → Claude Code default') forces re-reading.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Mostly efficient procedural content (templates, tables, page budgets), but it could be tightened: the venue/page-count rules are duplicated between 'Constants' and 'Key Rules' ('For IEEE venues: references ARE included in page count' appears in both), and the reviewer-routing preamble ('Before each reviewer slot, follow Selectable Reviewers...') is dense and partially redundant with Step 6's resolution note. Not the anchor-4 case, since these are more than trivial trims; not anchor 2, since there is no concept-explaining filler. | 3 / 5 |
Actionability | Fully executable guidance throughout: a copy-paste-ready bash block for the style-ref helper with explicit exit-code handling (case 0/2/3/*), a concrete MCP invocation with model and config ('model: gpt-6-astra, config: {"model_reasoning_effort": "xhigh"}'), and concrete output templates (Claims-Evidence Matrix table, section-by-section plan, Figure Plan table, GAP_REPORT.md skeleton, PAPER_PLAN.md skeleton). Not score 4: the common cases (with/without style-ref, with/without CLAIMS_FROM_RESULTS.md) are each covered with specific instructions. | 5 / 5 |
Workflow Clarity | A clear 7-step sequence (extract claims → structure → section planning → figure plan → citations → cross-review → output) with a feedback loop ('Apply feedback before finalizing') and error handling in the style-ref block. Minor validation gaps keep it below 5: there is no explicit final check that the section page budgets sum to MAX_PAGES after reviewer feedback is applied, and Step 6's reviewer resolution depends on external machinery ('.aris/reviewer.json', 'reviewer_route.py') that is referenced but not defined here. Above anchor 3 because validation checkpoints (helper exit codes, verdict: REVIEW_UNAVAILABLE handling, [VERIFY] citation flags) are explicit. | 4 / 5 |
Progressive Disclosure | The skill practices disclosure discipline in text ('Only load these references when needed; do not paste their full contents into the working draft'), but every referenced file is missing from the bundle: '../shared-references/writing-principles.md', 'venue-checklists.md', 'reviewer-backends.md', 'reviewer-independence.md', 'output-versioning.md', 'output-manifest.md', 'output-language.md', 'integration-contract.md', and 'tools/extract_paper_style.py' — the bundle contains only SKILL.md. Anchor 2 fits ('references are buried' / broken): a consumer of this bundle cannot navigate to any of the core detail the workflow depends on. | 2 / 5 |
Total | 14 / 20 Passed |