Content
46%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is well-organized and token-efficient with useful use/don't-use and safety sections, but its substance is a high-level checklist whose only source of detail — the referenced implementation playbook — is missing from the bundle. Fixing the broken reference and adding concrete, executable guidance are the highest-impact improvements.
Suggestions
Ship the referenced `resources/implementation-playbook.md` in the bundle (or remove the reference) — as delivered, both the Instructions and Resources sections point to a file that does not exist.
Make instructions executable: give concrete specifics such as cost-model components (spread, commission, slippage, borrow), walk-forward window parameters (train/test sizes, anchor vs. rolling), and an example backtest structure.
Add validation checkpoints, e.g., 'Verify the data pipeline contains no lookahead (point-in-time only)', 'Sanity-check results against a buy-and-hold benchmark before reporting metrics'.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and assumes Claude's competence — no explanations of what backtesting is, no library tutorials — and the 'Use/Do not use when' bullets earn their tokens. It falls short of score 5 only because the opening line repeats the frontmatter description verbatim and 'avoid common pitfalls' is padding that could be trimmed. | 4 / 5 |
Actionability | The Instructions are a topic checklist ('Define hypothesis, universe, timeframe...', 'Build point-in-time data pipelines and realistic cost models') with no executable steps, parameters, or examples — matching the score-2 anchor (high-level hints missing the specific steps to execute). It is not score 3 because there is no partially-complete concrete guidance: all detail is deferred to `resources/implementation-playbook.md`, which does not exist in the bundle. | 2 / 5 |
Workflow Clarity | The four instructions form a logical sequence (define → build data → implement simulation → validate with splits/walk-forward), but there are no validation checkpoints or error-recovery steps, matching the score-3 anchor (sequence present, checkpoints missing or implicit). Backtesting is not a destructive or batch operation, so the score-3 cap for missing feedback loops is not the binding constraint; the natural fit is 3, not 4, which requires most checkpoints to be explicit. | 3 / 5 |
Progressive Disclosure | The body defers all detailed patterns and examples to `resources/implementation-playbook.md`, but no such file (or resources/ directory) exists in the bundle — the single one-level reference is clearly signaled yet dangling, so navigation dead-ends. This matches the score-2 anchor (minimal structure, content that belongs in the skill effectively absent) rather than score 3, where references are present and real but weakly signaled. | 2 / 5 |
Total | 11 / 20 Passed |