Content
96%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is a lean, fully executable six-step workflow with concrete commands, a cost-approval gate before spending money, and explicit error-recovery feedback loops for every job terminal state. Its only structural weakness is that all detail, including the flags table and job-state reference, is inlined in SKILL.md rather than split into a reference file.
Suggestions
Move the flags table (`--gpus`, `--disk-gb`, `--any-gpu`, `--gpu-order`, `--secret`) and the job terminal-state reference into a `references/aq-reference.md` file linked from steps 4 and 5, keeping SKILL.md a lean workflow overview.
Consider splitting the Secrets subsection (env secrets vs. registry secrets) into its own reference file, since it covers two distinct flows only needed when private assets are involved.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Every token carries aq- or platform-specific operational knowledge Claude cannot already know ("Many slim images do not have them, including the `pytorch/pytorch` and `nvidia/cuda` runtime tags"; "Every `aq` call prints a one-line `aq: api https://...` banner on stderr; it is not an error"), with zero conceptual padding or pre-taught explanations. Not 4: there is no over-explanation anywhere that could be trimmed. | 5 / 5 |
Actionability | Fully executable, copy-paste-ready guidance at every step: the install one-liner, the base64 script-inlining pattern, a complete `aq job run` invocation, a bounded poll loop with `case "$s" in succeeded|failed|UNSERVABLE|cancelled) break;; esac`, and `aq job pull <job> ./results`. Not 4: the common cases (fine-tuning, HF_TOKEN secret, private registry image) are each covered with concrete, runnable specifics. | 5 / 5 |
Workflow Clarity | Six clearly numbered steps with explicit validation checkpoints and error-recovery feedback loops for every terminal state ("failed: ... Read `aq job logs <job>`, fix the command, and start a new job"; "UNSERVABLE: ... Start it again with more `--gpu-model` choices"), plus a cost-approval gate ("tell the user the GPU models, the hourly price and your estimate of the total, and wait for a yes") and a queued->10min diagnostic path. The batch-operation cap does not apply because status verification, cost reporting, and result reporting are all explicit. Not 4: feedback loops are present for every failure mode. | 5 / 5 |
Progressive Disclosure | Well-organized sections with easy navigation, and bulk material correctly offloaded to clearly signaled external resources ("Full command reference: `aq help`"; "GPU jobs on the CLI: https://docs.aquanode.io/docs/jobs/cli"). However, all ~190 lines of detail — including the `--gpus`/`--disk-gb`/`--any-gpu`/`--gpu-order`/`--secret` flags table and the terminal-state reference — are inlined in SKILL.md with no bundle split. Not 5: content is not split across files and the under-50-line exception does not apply at this length; not 3: the structure is clean and nothing is buried or nested. | 4 / 5 |
Total | 19 / 20 Passed |