Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is a lean, highly actionable workflow: five sequenced steps with templates, exact paths, glob examples, and a verification checklist, plus a pitfalls table with concrete fixes. Its only weaknesses are minor — slight redundancy between the checklist and earlier steps, and no explicit fix-and-retry loop for harness-eval validation failures.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Quotes: "Be concise — instructions share the context window; only include what the agent wouldn't already know" — the body practices what it preaches, with no explanations of concepts Claude already knows and tight sections throughout. Not a 5 because there is minor redundancy: the verification checklist and the 'Missing applyTo' pitfall row restate rules already given in Steps 3–4, so a few tokens could be trimmed; well above the 3 anchor ('some unnecessary explanation'). | 4 / 5 |
Actionability | Quotes: ".github/instructions/<topic>.instructions.md", a complete YAML frontmatter template with per-field comments, "applyTo" glob examples ("**/*.cs", "test/**"), concrete filename examples, a recommended-sections template, and a precise eval id derivation rule ("path relative to .github/instructions/ with its suffix removed and nested path separators replaced by --"). This is copy-paste-ready guidance covering the common cases for an instruction-authoring skill (per the rubric's code_vs_instruction note, absence of code is not penalized when guidance is this concrete). The one delegation ("Follow the authoring and validation rules in eng/harness-evaluation/README.md") points to a real repo file with a specific path, which is appropriate rather than a gap. | 5 / 5 |
Workflow Clarity | Quotes: five clearly sequenced steps ("Investigate the topic" → "Choose the file location" → "Generate the file" → "Write the body content" → "Author and validate the harness evaluation"), each with concrete sub-guidance, plus an explicit 8-item verification checklist and "produce and lint the requested instruction and eval before running behavioral comparisons". It falls short of the 5 anchor only because there is no explicit error-recovery feedback loop (e.g., 'if validation fails, fix and re-validate') for the harness-eval step; it clearly exceeds the 3 anchor since checkpoints are explicit, not implicit. | 4 / 5 |
Progressive Disclosure | The body is well-organized into scannable sections (When Not to Use, Workflow, Common Pitfalls) with no bundle files needed — no content that clearly belongs in separate files is inlined, and the only external pointer ("eng/harness-evaluation/README.md") is clearly signaled, one level deep, and points to a repo file rather than creating nested skill references. This matches the 5 anchor's 'easy navigation' with appropriately placed content. | 5 / 5 |
Total | 18 / 20 Passed |