Content
82%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary operational skill body: a complete executable command with the exact failure modes, gotchas (load-bearing cd, checkpoint version limits), expected output, and honest caveats about what the soluble prior does and does not guarantee. The only deductions are minor — slight redundancy in the model-mechanism explanation and a caveat-driven rather than explicitly sequenced campaign workflow.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and expert-level — it assumes knowledge of inverse folding and adds only operational facts (repo-relative imports, checkpoint availability at v_48_010/v_48_020 only, CPU sufficiency, no PyPI dist). A few trimmable spots remain: the intro's explanation of why the full-PDB model places surface hydrophobics ("because many of them are buried at crystallographic or membrane interfaces in the training set") partially duplicates the later note "that is the prior working, not a bug", fitting anchor 4 (efficient, minor over-explanation) rather than the every-token-earns-its-place anchor 5. | 4 / 5 |
Actionability | The running section is copy-paste ready: a complete pip/git/python command sequence with concrete flags (--pdb_path_chains "A", --sampling_temp "0.1", --use_soluble_model), the exact output location and header fields ("out/seqs/<stem>.fa with score= and seq_recovery="), plus concrete remediation ("--omit_AAs \"CW\"", LigandMPNN's --model_type soluble_mpnn) and known failure modes with causes. This matches anchor 5: fully executable commands covering the common cases, exceeding anchor 4's 'minor gaps'. | 5 / 5 |
Workflow Clarity | The single run action is unambiguous, and validation checkpoints are present ("check that the resulting designs still fold (via boltz or esmfold2) before assuming the constraint was free"; rank by an orthogonal predictor "before committing wet-lab slots"), with error-recovery guidance for the two known failure modes. However, the broader campaign flow (design, patch handling, filtering, folding, screening) is presented as caveat sections plus a "Next:" pointer rather than a clearly sequenced workflow, so it fits anchor 4 (clear sequence, most checkpoints, minor gaps) better than anchor 5's explicit ordered validate-fix-retry loop. | 4 / 5 |
Progressive Disclosure | No bundle files exist, so this is a single-file skill; sections are well-organized (Running it, two caveat sections, Next) and shared detail is appropriately deferred to sibling skills ("see proteinmpnn for the parsing quirks", ligandmpnn, boltz, esmfold2) instead of being inlined. It exceeds anchor 3 (no misplaced inline bulk, deferral is clearly signaled) but the body runs ~60 lines — above the sub-50-line compact-skill ideal that would justify anchor 5 with section organization alone — so anchor 4's 'good structure, minor organization gaps' is the best fit. | 4 / 5 |
Total | 17 / 20 Passed |