Content
37%Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The SKILL.md body is commendably concise and well-organized as a positioning/overview document, but it is almost entirely descriptive: it provides no executable guidance, no sequenced workflow, and—most critically—never points Claude to the bundled scripts that implement the actual regression-detection work.
Suggestions
Add a workflow section with concrete, ordered steps that invoke the bundled scripts, e.g. 1) run scripts/analyze_metrics.py against the baseline and current results, 2) review the returned regression JSON, 3) run scripts/generate_report.py, 4) run scripts/create_github_comment.py to post the summary.
Reference the bundled materials explicitly from the body (e.g. a "## Tooling" section linking scripts/analyze_metrics.py and the references/ guides) so Claude can discover and use the executable assets rather than relying on the descriptive "Typical Outputs" list.
Include a validation checkpoint in the workflow — e.g. confirm analyze_metrics.py reports no regressions or that severity thresholds are met before generating and posting the report — so the multi-step batch operation has an explicit feedback loop.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and assumes Claude's competence — it never explains what benchmarks, regressions, or CI/CD pipelines are, and every section (Positioning, When to Use, Not For, Typical Outputs, Related Skills) earns its place, matching the score-3 "every token earns its place" anchor. | 3 / 3 |
Actionability | The body offers no concrete code or commands — "Typical Outputs" ("A baseline-vs-current regression summary", "Severity-ranked regressed metrics") describes results rather than instructing how to produce them, and it never references the bundled executable scripts (analyze_metrics.py, generate_report.py, create_github_comment.py), fitting the score-1 "describes rather than instructs" anchor. | 1 / 3 |
Workflow Clarity | There is no sequenced procedure for the inherently multi-step analyze→report→comment pipeline, and "When to Use" lists use-cases rather than ordered steps, with no validation checkpoints, matching the score-1 anchor of steps missing and no validation mentioned; it is not a 2 because no steps are listed at all. | 1 / 3 |
Progressive Disclosure | The body is well-organized into clear sections (not a monolithic wall), but it fails to signal or navigate to the real bundle files — the scripts that perform the actual work are present in ./scripts/ yet never referenced from SKILL.md, fitting the score-2 anchor of references present but not clearly signaled. | 2 / 3 |
Total | 7 / 12 Passed |