Content
78%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured, domain-specific skill body: lean prose, executable commands with flags, exact output-format examples, and properly disclosed one-level-deep references that verifiably exist in the bundle. The main weaknesses are minor — a repo-layout-dependent script path that hurts copy-paste readiness, some duplication between Step 3/Resources and Step 4/report examples, and no explicit recovery step for exit-code-1 script failures.
Suggestions
Use the skill-relative script path ('scripts/check_data_quality.py') in the Step 2 commands, or note the assumed working directory, so the commands are copy-paste executable wherever the skill is installed.
Deduplicate the reference-file descriptions (Step 3 vs. Resources) and the severity-level definitions (Step 4 prose vs. the Markdown report example) to tighten token efficiency.
Add a brief explicit recovery checkpoint after script execution, e.g. 'If the script exits 1 (file not found / parse error), verify the --file path and re-run,' to complete the feedback loop.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is efficient and assumes competence — no space is spent explaining what FRED, ETFs, or markdown are; sections like 'Key Principles' carry genuinely non-obvious domain knowledge (section-aware allocation checking, digit-count heuristic, year inference priority). It falls short of level 5 ('every token earns its place') due to minor duplication: the two reference files are described twice (Step 3 and 'Resources'), and severity definitions appear both in Step 4 prose and again inside the Markdown report example. It is well above level 3, which would require genuinely unnecessary explanation. | 4 / 5 |
Actionability | Step 2 gives fully concrete, flag-level commands ('python3 skills/data-quality-checker/scripts/check_data_quality.py --file path/to/document.md --checks price_scale,dates,allocations --as-of 2026-02-28') and the Output Format section shows exact JSON/markdown structures with real examples ('GLD: $2,800 has 4 digits'). The gap from level 5 is the hardcoded 'skills/data-quality-checker/...' script path, which presumes a specific repo layout rather than the skill-relative 'scripts/check_data_quality.py' that actually ships in the bundle, so commands are not reliably copy-paste ready. Well above level 3 (pseudocode/missing details). | 4 / 5 |
Workflow Clarity | The five-step workflow (receive input → execute script → load references → review findings by severity → generate/present report) is clearly sequenced with concrete commands at the execution step, and Key Principle 1 defines exit-code semantics (0 on success even with findings, 1 for script failures), which is an explicit error signal. It does not reach level 5 ('explicit validation steps; feedback loops for error recovery') because there is no stated step for what to do on exit code 1 or how to verify the reports were produced — the sequence has minor validation gaps. The destructive/batch cap does not apply since the checker is read-only and advisory. | 4 / 5 |
Progressive Disclosure | The SKILL.md is a genuine overview: the error catalogs and notation standards are correctly split into references/instrument_notation_standard.md and references/common_data_errors.md (both verified to exist and contain substantive, relevant content), each signaled one level deep with a clear description of what it covers, and consolidated again in a Resources section. The main script lives in scripts/check_data_quality.py with tests alongside. This matches the level-5 anchor ('Clear overview with well-signaled one-level-deep references; content appropriately split; easy navigation'). | 5 / 5 |
Total | 17 / 20 Passed |