Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplarily lean, imperative skill body: no filler, no explanations of known concepts, concrete ledger and shell templates, a validated fail-fast workflow, and a verified progressive-disclosure map whose reference files all exist one level deep. The only gap is that concrete command templates exist for just one example domain rather than the general case.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is telegraphic and dense — sections like "Baseline first. Never keep an experiment before baseline evidence exists" and "Treat configured regression gates as absolute" carry operational content with zero explanation of concepts Claude already knows. Every token earns its place, matching the level-5 lean/efficient anchor; there is no over-explanation to justify level 4. | 5 / 5 |
Actionability | Concrete, executable artifacts are present: a copy-paste YAML ledger template with real commands ("./bin/ask evals run ... --json --robot"), a runnable shell iteration example ("uv run train.py --steps 200 --json", "pytest tests/regression_guard.py"), and an explicit decision rule "baseline - candidate >= min_delta". However, the generic workflow path ("Define parser contract, guard command, held-out checks...") stays at directive level without command templates outside the single LLM-training example domain — mostly executable with minor gaps, i.e. level 4 rather than the fully-covered level 5. | 4 / 5 |
Workflow Clarity | The 9-step numbered Workflow sequences the loop with explicit validation checkpoints (baseline-first rule, per-iteration Verify and Guard, step 6 re-reading state), plus a dedicated Validation section with a feedback loop ("Fail fast: stop at first failed gate; do not proceed until it is fixed and rerun") and a Repair section defining fix-rerun-broaden ordering. This batch/potentially destructive skill has validation present, so the level-3 cap does not apply; it matches the level-5 anchor with explicit validation and error-recovery loops. | 5 / 5 |
Progressive Disclosure | A dedicated "Progressive Disclosure" section maps each of the five reference files (autoresearch-project.md, contract.yaml, evals.yaml, task-profile.json, discovery-interview.md) to its purpose, and all five exist as substantive files one level deep with no further nesting. The body stays a lean overview while details live in the bundle — matching the level-5 anchor of well-signaled one-level-deep references with easy navigation. | 5 / 5 |
Total | 19 / 20 Passed |