Content
88%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-engineered orchestration skill: fully actionable commands, thresholds, and templates, with an explicitly sequenced workflow containing the validation and recovery loops its GPU-deployment scope demands. The remaining polish is structural — the long inline review prompt and debug protocol belong in reference files, and a couple of duplicated rules could be trimmed.
Suggestions
Move the Phase 2.5 Codex review prompt (including the SCOPE LIMITS block) into a reference file such as references/codex-review-prompt.md, leaving a three-line summary plus the checklist essentials inline.
The ground-truth-evaluation rule appears both in the review prompt's checklist and in Key Rules; keep the CRITICAL Key Rules entry and shorten the prompt's item 5 to a pointer.
The referenced shared files (../shared-references/*.md, templates/RESEARCH_CONTRACT_TEMPLATE.md) are not present in this bundle; either ship them or inline the one-line essentials for each so the skill remains actionable when they are absent.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is almost purely operational — routing rules, budgets, templates, and status formats — and assumes Claude's competence without explaining known concepts, fitting the 'efficient; minor instances of over-explanation that could be trimmed' anchor. It is not a 5 because the ground-truth rule is stated in both the review prompt and Key Rules, and the dense reviewer-routing blockquote plus the ~50-line inline review prompt could be tightened. | 4 / 5 |
Actionability | Guidance is fully executable: exact file paths (refine-logs/EXPERIMENT_PLAN.md), concrete thresholds ("≤5 jobs" vs "≥10 jobs" routing, "2 patch attempts" + "2 clean reimplements"), a ready-to-run MCP call with model/config, and copy-paste templates for status blocks and result files — matching the 'fully executable; copy-paste ready' anchor. It is not below 5 since even the prompt placeholders ([paste the experiment scripts]) are inherent to a fill-in template, not vague direction. | 5 / 5 |
Workflow Clarity | Six phases are clearly sequenced (parse → implement → review → sanity → deploy → collect → handoff) with explicit validation checkpoints (sanity-first gate, cross-model review before deploy, AUTO_DEPLOY=false confirmation, success-criteria check) and feedback loops for error recovery (capped debug budget, re-review max 2 rounds, escalate-to-human rule), matching the top anchor. The batch/deployment nature of the operation makes these validation loops essential, and they are all present. | 5 / 5 |
Progressive Disclosure | Structure is good: well-sectioned phases, and offloaded details are one level deep and clearly signaled with descriptive links (output versioning/manifest/language protocols in ../shared-references/, the experiment-queue manifest format in its SKILL.md). It is not a 5 because sizable chunks that would fit a references/ file are inlined (the Codex review prompt with its scope-limits block, the full debug protocol), and no bundle files exist alongside SKILL.md to carry that content. | 4 / 5 |
Total | 18 / 20 Passed |