Content
81%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A tightly written, well-sequenced operational workflow with a genuine verification ladder and highly specific, non-inferable rules for scenario design, fixtures, and shims. The main gaps are that the hardest artifacts (setup.sh, recording shims) are described rather than exemplified, and everything is inlined in one file with no bundle references.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with non-obvious, domain-specific rules (the tessl manifest recipe, the `scenario-N` downloader-collision rationale, shim flag-parsing like 'taking the token after a value-taking flag as that value even when it starts with `-`') and assumes competence, with no padding explaining concepts Claude already knows. It falls short of 5 only through minor redundancy: 'Never grade behaviour the unit does not document' appears in section 3.7 and again in Non-goals, and the HARD BOUNDARY overlaps the frontmatter's 'never restructures plugins'. | 4 / 5 |
Actionability | Executable commands appear throughout ("jq '[.checklist[].max_score] | add' returns exactly 100", "git worktree add .worktrees/eval-<plugin> -b evals/<plugin> HEAD", "make test && make validate") plus exact JSON templates for scenario.json and criteria.json. It is not 5 because the two trickiest artifacts — inputs/setup.sh and the recording shims — are specified by description rather than shown as copy-paste code, and the worked example lives outside the skill bundle ('See the git-workflow PR scenario'). | 4 / 5 |
Workflow Clarity | Seven clearly sequenced phases (inventory, structure, design, offline gradeability, verification ladder, commit, batching) with an explicit checklist section headed 'run ALL before claiming done' containing exact commands and expected outcomes, plus explicit error-recovery and stop conditions ('If it fails for reasons unrelated to your scenarios, stop and report - do not modify manifests'). Batch and destructive operations (committing, temp-dir cleanup) are validation-gated, so the destructive/batch cap does not apply. Not 4: validation checkpoints are pervasive, not just present. | 5 / 5 |
Progressive Disclosure | The body is well-sectioned (##/###) with clearly signaled, one-level-deep external pointers ('plugins/git-workflow/evals/ in this repository is the canonical worked example - read one of its scenarios before writing new ones') and no nested reference chains. It is not 5 because no bundle reference files exist (no references/, scripts/, or assets/), so dense detail such as the shim specification and the section 7 orchestrator batching notes is inlined in a ~220-line body that could be split; it is not 3 because the inlined material mostly belongs in the main workflow file and organization is good. | 4 / 5 |
Total | 17 / 20 Passed |