Content
75%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A tight, highly actionable command skill with a clear five-step setup, a concrete cron mapping, and a well-specified recurring prompt including crash-streak safety rules. Its main weaknesses are a referenced evaluation script that is missing from the bundle, a triple-stated expiry limitation, and missing validation on DISCARD outcomes.
Suggestions
Ship scripts/run_experiment.py in the bundle (or point to where it lives in the ar: suite) so the iteration command "python {skill_path}/scripts/run_experiment.py --experiment {domain}/{name} --single" is actually executable.
State the 3-day auto-expiry once (in Important Limitations) and drop the duplicate lines from the confirmation template.
Add an explicit instruction for what the iteration should do on a DISCARD or CRASH outcome (e.g., revert the commit, record the failure) so the feedback loop is complete.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is efficient — command examples, a cron mapping table, a fill-in prompt template, and a JSON schema with no padding or explanations of concepts Claude already knows. The one trimmable redundancy is the 3-day auto-expiry stated three times ("Auto-expires: 3 days (CronCreate limit)", the "Note: Recurring jobs auto-expire after 3 days" line in the confirmation block, and the "3-day auto-expiry" bullet in Important Limitations), which fits anchor 4 ("Efficient; minor instances of over-explanation that could be trimmed") rather than anchor 5's every-token-earns-its-place. | 4 / 5 |
Actionability | Guidance is almost entirely executable: exact CLI invocations, a concrete cron-expression table, a copy-paste CronCreate prompt template with clearly marked placeholders, an exact loop.json shape, and a numbered stop procedure. The gap is that the iteration instructions call "python {skill_path}/scripts/run_experiment.py --experiment {domain}/{name} --single", a script that is not present in this bundle (no scripts/ directory exists), so that command cannot be executed as delivered — anchor 4 ("Mostly executable guidance; concrete code or commands with minor gaps") rather than anchor 5's fully copy-paste-ready coverage. | 4 / 5 |
Workflow Clarity | The setup flow (resolve experiment → select interval → create job → store metadata → confirm) and the stop flow are clearly sequenced, and the recurring prompt embeds feedback loops — "Read the output (KEEP/DISCARD/CRASH)" and "If 5 consecutive crashes in results.tsv, delete this cron job (CronDelete) and alert" — which guard the batch/automated-commit operation. Minor validation gaps remain: no instruction on what to do after a DISCARD outcome, and no verification step between CronCreate and writing loop.json (the cron_id is captured implicitly). This matches anchor 4 ("Clear sequence with most checkpoints present; minor validation gaps") rather than anchor 5's explicit validation steps with error-recovery loops, and the crash-streak/evaluate checkpoints keep it above anchor 3. | 4 / 5 |
Progressive Disclosure | The single-file body is well organized into clearly signaled sections (Usage, What It Does by step, Stopping a Loop, Important Limitations) with content appropriately placed inline for a ~116-line command skill. Anchor 5 is not reached because the body points to paths that are not in the bundle — "{skill_path}/scripts/run_experiment.py" and the "/ar:ar-status" command are dangling references with no scripts/ or references/ directory present — fitting anchor 4 ("Good structure; most content is appropriately placed; references mostly clear; minor organization gaps") rather than anchor 5's clean, fully resolvable one-level-deep references. | 4 / 5 |
Total | 16 / 20 Passed |