Content
93%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary single-file skill: a fully executable quick-start, dense coverage of the flag quirks and silent failure modes that actually trip practitioners, and clean sectioned structure with no filler. The only gap is the absence of explicit validation checkpoints after the run (e.g. verifying fixed positions held or screening on score/seq_recovery before downstream folding).
Suggestions
Add a one-line post-run validation step after the output section, e.g. confirm fixed residues are unchanged in the .fa records and sanity-check seq_recovery before dispatching downstream folding jobs.
In the fixed-positions section, give the one-line invocation of helper_scripts/make_fixed_positions_dict.py so the 'worth the extra call' advice is directly executable.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Every section carries non-obvious operational knowledge: flag parsing quirks ('--sampling_temp is parsed as a space-separated string... commas never split'), the silent fixed-positions failure mode, checkpoint selection by training noise, and a compact error table. Nothing explains what proteins or inverse folding are; no padding anywhere. | 5 / 5 |
Actionability | The run block is copy-paste executable end to end (pip install, shallow clone, full command with flags), output location and header fields are spelled out ('out/seqs/<pdb_stem>.fa', 'score=', 'global_score=', 'seq_recovery='), and the error table prescribes exact diagnostic commands like "grep '^ATOM' file.pdb \| cut -c22 \| sort -u". | 5 / 5 |
Workflow Clarity | The sequence (install → clone → run → read outputs → fold downstream) is clear, and the 'Errors worth recognizing' table gives recovery guidance for the main failure modes. It stops short of explicit validation checkpoints — e.g. there is no proactive step to confirm fixed positions were actually held or to sanity-check seq_recovery before spending compute on folding — matching 'most checkpoints present; minor validation gaps'. | 4 / 5 |
Progressive Disclosure | This is a self-contained single-file skill (no references/, scripts/, or assets/ bundle exists) of ~70 lines, and all content — one run command, two flag gotchas, a checkpoint table, an error table — is appropriately inline rather than split out. Sections are well-headed and navigable, satisfying the simple-skill exception for a skill with no need for external references. | 5 / 5 |
Total | 19 / 20 Passed |