Content
85%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exceptionally actionable, information-dense body with a well-sequenced, validation-rich workflow that respects the reader's intelligence. The structural weakness is that everything — supervisor unit files, platform quirks, calibration tables, config reference — lives inline in one long file with no one-level-deep references.
Suggestions
Move the launchd plist and systemd unit templates into an assets/ or references/ file and link them from a short 'Supervisor setup' pointer, keeping only the survival-guarantee table inline.
Split the platform behavior notes (--marketId vs --marketTopicId, realizedPnl vs pnl, redemption semantics) and the streak calibration table into a references/ file (e.g. PLATFORM.md, SIGNAL.md) with clearly signaled one-level-deep links from SKILL.md.
Deduplicate the 'hit rate is not edge' / unverifiability discussion, which is stated in the Read-this-first box, the priced-in step, the strategy-hooks section, and Known limitations — one canonical statement plus cross-references would trim tokens.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Nearly every token carries non-obvious, platform-specific information (overround measurements, ±1.9pp error bars, '--marketId, not --marketTopicId', 'realizedPnl; pnl comes back null') and no space is spent explaining concepts Claude already knows. Not 5 because a few points are repeated across sections — 'a hit rate is not an edge' appears in the Read-this-first box, the priced-in discussion, and Known limitations, and the unverifiability figures appear twice. | 4 / 5 |
Actionability | Fully executable throughout: exact commands ('python3 backtest.py fetch --symbol BTCUSDT --interval 1h'), copy-paste launchd/systemd unit files, pre-flight check commands, concrete hook signatures ('estimate_probability(rnd, ctx) -> float | None'), and config tables with a 'How to decide it' column. Matches the copy-paste-ready level-5 anchor. | 5 / 5 |
Workflow Clarity | The six-step Getting started sequence is explicitly ordered with validation checkpoints that can kill the idea ('Steps 1 and 3 cost nothing and either can kill the idea'), a stop condition ('A gap near zero… stop there'), dry-run before live, a live gate ack file, and error-recovery feedback loops (back-off 15s→300s, quote refetch, FAILED-order stake return). Despite handling live capital, validation is thorough — matches the level-5 anchor. | 5 / 5 |
Progressive Disclosure | Section headers are clear and the bundle scripts (updown.py, backtest.py) referenced in the body are real files, but there are no reference files at all: the launchd/systemd unit files, platform behavior notes, calibration tables, and the full configuration reference are all inlined in one ~450-line SKILL.md. This sits between the level-2 anchor (content that belongs in separate files is inlined) and level-4 (most content appropriately placed) — structure is good but the split is missing entirely. | 3 / 5 |
Total | 17 / 20 Passed |