Content
75%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A dense, expert-level body: executable workflow commands for both runners, explicit integrity and failure semantics, and well-signaled one-level-deep references with a clean Additional Resources section. The remaining gaps are minor — rationale passages that could be deferred, inlined reference-grade detail in 'Cases' and 'Reading results', and an unstated recovery step for integrity failures.
Suggestions
Trim or defer the sham-arm publication rationale and the codex token-rotation explanation to grader-design.md / runbook.md, keeping one operational sentence each in SKILL.md.
Move the per-target manual-column enumerations (inquire/grasp/conduct lists) in 'Reading results' into runbook.md, keeping a one-line summary per target in the body.
Add one line stating the recovery action when a row's integrity falls short of its run count (e.g. re-run that arm) to close the feedback loop.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and operational with zero padding of concepts Claude already knows — no basic explanations anywhere. A few justification passages, such as the sham-arm rationale ("Published work on rule files for coding agents found random rules helping as much as curated ones, which makes 'a long structured instruction is present' a live alternative explanation") and the ChatGPT-login refresh-token rotation explanation, carry argumentation that could be trimmed or deferred to a reference. That places it at 'efficient; minor instances of over-explanation that could be trimmed' — not level 5's 'every token earns its place', well above level 3's 'some unnecessary explanation'. | 4 / 5 |
Actionability | The Workflow section gives copy-paste-ready commands for both runners ('cd .claude/skills/realize/scripts', './setup.sh inquire', 'REALIZE_RUNNER=codex ./run.sh inquire', './teardown.sh inquire'), and the one placeholder (export CLAUDE_CODE_OAUTH_TOKEN="$(...)") is explicitly justified as the interactive step. It stops short of level 5 because a complete first run also requires reading references/runbook.md — minor gaps, matching 'mostly executable guidance with minor gaps'. | 4 / 5 |
Workflow Clarity | Setup→run→teardown is clearly sequenced per runner with explicit validation semantics: 'Read integrity first', rows whose integrity falls short are 'not evidence about the protocol' and reprinted separately, and failures 'make run or report exit non-zero while preserving partial transcripts for inspection' — and protocol-prose 'refuses to run when the copy lost none'. It sits between anchors 4 and 5: the checkpoints are present, but what to do when integrity fails (the recovery action) is not stated in the body, so it does not reach level 5's 'feedback loops for error recovery'. | 4 / 5 |
Progressive Disclosure | References are well-signaled and exactly one level deep, each with a stated purpose ('references/runbook.md — the workflow, where isolation lives, how to widen the matrix', 'references/grader-design.md — why the deterministic axis is behaviour rather than wording', 'scripts/harness.mjs — the runner and the deterministic graders'), and all referenced references/ and scripts/ files exist in the bundle. It is not level 5 because reference-grade detail — the per-target manual-column enumerations for inquire, grasp, and conduct in 'Reading results', and the worked-pair construction details in 'Cases' — is inlined in SKILL.md rather than split out. | 4 / 5 |
Total | 16 / 20 Passed |