Content
96%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A dense, high-quality instruction skill: every token carries product-specific knowledge, tool calls are exact and copy-paste ready, and workflows include explicit validation and error-recovery loops. The only minor weakness is that all reference detail lives inline in a slightly long SKILL.md with no offloaded reference files.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and assumes competence: every line carries Open-SWE-specific facts Claude cannot know ('The old sandbox is detached, not deleted', 'Never write a secret to disk — the proxy injects git auth per run'). Nothing explains concepts Claude already knows and nothing is padded, matching the score-5 anchor rather than the score-4 anchor's 'minor instances of over-explanation'. | 5 / 5 |
Actionability | Guidance is fully executable for an instruction-only skill: exact tool invocations with parameters ('publish_workspace', 'recreate_sandbox(source="base")', 'snapshotctl(action="edit")', 'background_task("status", task_id)'), exact paths ('/open-swe/environment/logs/', '/workspace/<repo>', 'OPENSWE_WORKSPACE_REPOS'), and concrete script requirements ('set -euo pipefail', install rg, gh). The common cases (edit / fork / from scratch) are each covered with specific next actions, matching the score-5 anchor. | 5 / 5 |
Workflow Clarity | Multi-step processes are clearly sequenced with explicit validation checkpoints and feedback loops: 'when it works you call publish_workspace', the nightly replay 'replaces the image only if it exits 0', and on failure 'Fix the script with snapshotctl(action="edit") … then rebuild again' while 'the previous image stays in place'. This matches the score-5 anchor (explicit validation, error-recovery loops) rather than score 4, whose checkpoints would be merely 'most' present. | 5 / 5 |
Progressive Disclosure | Sections are well-organized and clearly navigable (routing table, per-topic sections, no nested references), and no bundle files exist so nothing can be offloaded. However, the ~85-line body exceeds the under-50-line simple-skill case and keeps all reference-style detail (refresh stages, log locations, snapshot naming) inline, fitting the score-4 anchor ('good structure; most content appropriately placed; minor organization gaps') better than score 5. | 4 / 5 |
Total | 19 / 20 Passed |