Content
50%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The skill has a sensible skeleton (use/don't-use, terse instructions, safety, boundaries) and unusually specific simulation guardrails, but it delivers no executable depth: the detailed playbook it points to is missing, the workflow lacks explicit validation checkpoints, and the dense boundaries paragraph plus boilerplate Limitations dilute token efficiency. It functions as an overview of a skill whose substance is largely absent.
Suggestions
Provide the referenced 'resources/implementation-playbook.md' in the bundle, or remove the two references to it so the skill does not promise detail it cannot deliver.
Break the 'Simulation boundaries' run-on paragraph into labeled bullet groups (execution model, unmodeled effects, metrics, walk-forward/bootstrap, reporting) so the constraints are scannable instead of a wall of text.
Add explicit validation checkpoints to the workflow (e.g. verify no lookahead in features, confirm holdout was never used in parameter search, record data versions/seeds/all trials before reporting results) and drop the generic Limitations boilerplate.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is mostly tight (terse Use/Do-not-use, Instructions, and Safety bullets), but the 'Limitations' section is generic boilerplate, the opening line duplicates the frontmatter description verbatim, and the ~250-word single-paragraph 'Simulation boundaries' section could be tightened into structured bullets. It is not noticeably padded enough for a 2, but several parts could be trimmed, keeping it at the level-3 anchor. | 3 / 5 |
Actionability | The Instructions are high-level directives ('Build point-in-time data pipelines and realistic cost models', 'Implement event-driven simulation') with no code, commands, or specific steps, but the 'Simulation boundaries' section provides genuinely concrete executable guardrails (sorted unique timestamps, finite positive OHLC, 252 trading-day annualization, preserve initial wealth, report undefined ratios). Concrete guidance exists but the core build process is abstract, and the detailed examples are deferred to a referenced playbook. | 3 / 5 |
Workflow Clarity | The Instructions imply a rough lifecycle sequence (define hypothesis -> build data pipelines and cost models -> implement simulation -> train/validation/test and walk-forward), but validation checkpoints are implicit at best; record-keeping and untouched-holdout guidance in 'Simulation boundaries' partially covers verification without being framed as workflow steps. For a batch analytical operation, the sequence is present but checkpoints are missing, matching the level-3 anchor. | 3 / 5 |
Progressive Disclosure | The body is well sectioned and clearly signals a single one-level-deep reference ('resources/implementation-playbook.md' in both Instructions and a Resources section), but that file does not exist in the bundle, so the promised detailed patterns and examples layer is absent. Scored against the actual (empty) bundle structure, the navigation promise is broken, which is a worse defect than the 'references not clearly signaled' of the level-3 anchor but not monolithic or buried content. | 3 / 5 |
Total | 12 / 20 Passed |