Content
75%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A high-quality, deeply actionable review catalog: every check names exact harness keys and assertion types, fixes are specific changes rather than categories, and the worked example demonstrates the full output contract. The main cost is length — front-matter sections overlap each other and several explanatory passages could be compressed without losing substance.
Suggestions
Collapse the "What this owns, and what it does not" table and the follow-up paragraph into the intro or Limitations section — they make the same scoping point three times.
Compress the secondary "Why..." subsections ("Related risk when adding coverage", "Why the comparison itself needs care", "Secondary concern") to one sentence each, or fold them into the Fix lines they modify.
Give "The judge is a model under test" a number or move it after anti-pattern 8 so the 1–8 check sequence reads unbroken, and consider moving the worked example to a reference file to shorten the always-loaded body.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is expert-level with no basic-concept padding, but at roughly 430 lines it could be meaningfully tightened: the "What this owns, and what it does not" table restates both the intro and the Limitations section, and multi-paragraph "Why it invalidates" passages (e.g. anti-pattern 5's "Why the comparison itself needs care") run long where one sentence would carry the point. This fits anchor 3 ('could be tightened') better than anchor 4's 'minor instances of over-explanation'. | 3 / 5 |
Actionability | Guidance is fully concrete and executable: exact assertion names per harness (`equals`, `contains`, `llm-rubric`, `similar` with a `threshold`), copy-ready YAML snippets, the three-level Promptfoo grader override syntax (`promptfoo eval --grader <provider>`, `defaultTest.options.provider`, assertion-level `provider`), a measured procedure for setting similarity thresholds, and a complete worked example that produces the exact specified output table. Per the rubric's code-vs-instruction note, an instruction-only skill with this level of specificity matches anchor 5. | 5 / 5 |
Workflow Clarity | The review sequence is clear from structure — map the five slots (numbered 1–5), apply eight Detect/Why/Fix checks, then report in the mandated format with checkpoints like "Every row cites a file and line, or names the file and marks the finding absent". It stops short of anchor 5 because the overall procedure order is implied by layout rather than stated as an ordered list, and the unnumbered "The judge is a model under test" section interrupts the 1–8 check numbering. | 4 / 5 |
Progressive Disclosure | Both referenced files exist, are one level deep, and are well signaled with their contents described (citations.md for full academic citations, harness-mapping.md for per-harness slot vocabulary), with the core catalog correctly kept inline. Minor gaps keep it at anchor 4 rather than 5: the unnumbered judge-validation section is awkwardly interleaved between anti-patterns 4 and 5, and the body length pushes the limit of what belongs in SKILL.md versus a reference file. | 4 / 5 |
Total | 16 / 20 Passed |