Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An excellent, densely informative body: executable pinned install and inference code, paper-matched parameter tables, and unusually good gotcha/failure-mode coverage with concrete recovery steps. Detail is appropriately offloaded to two real, well-signaled reference files. The only deductions are minor: a duplicated ESMC warning and no explicit output-validation step in the workflow.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with non-obvious, high-value detail ("Default kernel backend is `None` (reference PyTorch, ~12x slower than paper)", the structseq single-tuple constructor note, the cusolver SVD poison fix) and never explains concepts Claude already knows. It falls short of anchor 5 only through redundancy: the ESMC `<mask>`-token warning appears verbatim in both the body and references/esmc.md, and license/metadata is duplicated between the frontmatter comments and the body. Not 3 — there is no padded or unnecessary explanation. | 4 / 5 |
Actionability | Fully executable, copy-paste-ready guidance throughout: exact pinned install commands, a complete fold() example with annotated paper-faithful parameters, a working SVD monkeypatch, and concrete fallback commands ("fall back to set_kernel_backend(None) + set_chunk_size(64)"). Specific examples cover the common cases (complex folding, MSA input, variant selection, backend tuning), matching anchor 5. | 5 / 5 |
Workflow Clarity | A clear install → usage → throughput → troubleshooting sequence with strong error-recovery guidance for known failure modes (illegal memory access above L≈1400 with fallback, cuequivariance silent-fallback warning, a3m null-byte cleaning, NaN-poisoned cusolver workspace). It misses anchor 5 only because there is no explicit output-validation checkpoint (e.g., sanity-checking the ranked prediction before writing the CIF); it is well above anchor 3, whose checkpoints would be merely implicit. | 4 / 5 |
Progressive Disclosure | Scored against the actual bundle: both referenced files (references/design-hook.md, references/esmc.md) exist, are one level deep with no nesting, and are clearly signaled in context ("see `references/design-hook.md`"; "Full API, mutation scoring, SAE features, contact prediction: see `references/esmc.md`"). The body is an overview with ESMC and design-hook detail appropriately split out — matches anchor 5. | 5 / 5 |
Total | 18 / 20 Passed |