Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A dense, pitfall-aware guide with copy-paste-ready executable examples for all three SDK tasks, an explicit validated multi-step workflow, and a well-structured one-level-deep bundle in which every referenced file exists and is clearly signaled. The only soft spot is conciseness: inline version pins and date-stamped model identifiers, plus a lengthy citation protocol, leave minor room for trimming.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Dense, pitfall-focused prose that assumes competence (no explanations of what proteins or embeddings are) and surfaces non-obvious facts like import-time token capture, "T is not the raw residue count", 1-based inclusive ranges, and the chain_id="all" default. It stops short of anchor 5 because time-sensitive details are inlined rather than isolated (version pins "esm==3.4.1.post1", date-stamped model IDs like "esmfold2-fast-2026-05") and the citation-fetching protocol is somewhat long — minor trims are possible, but not the padded over-explanation of anchor 3. | 4 / 5 |
Actionability | Fully executable, copy-paste-ready guidance: exact install commands ("uv venv --python 3.12", "uv pip install ... esm==3.4.1.post1"), a task-to-model mapping table, and three complete code blocks with imports, model IDs, error checks, and asserts covering the three common cases (ESM3 generation, ESMC embeddings, hosted folding). Matches the top anchor. | 5 / 5 |
Workflow Clarity | The five-step Workflow is clearly sequenced with explicit validation checkpoints — "Check every SDK result for ESMProteinError", "Validate the output contract: sequence length and fixed residues..." — plus input validation in step 1 ("Reject accidental `...`, spaces, FASTA headers or gaps"), all mirrored by isinstance/raise/assert checks in every code block. This matches the top anchor's explicit validation steps; the operations are non-destructive, so the batch-operation cap does not apply. | 5 / 5 |
Progressive Disclosure | Verified against the actual bundle: every referenced file exists (references/forge-api.md, esm3-api.md, esm-c-api.md, biohub-platform.md, workflows.md, review.md, scripts/esm_embeddings.py), each link is well-signaled with its purpose (e.g., "See [ESM3](references/esm3-api.md) for inverse folding, function vocabulary and coordinate conventions"), and references are exactly one level deep — reference files link only to external sources, not to other bundle files. Clear overview with appropriately split content and easy navigation, matching the top anchor. | 5 / 5 |
Total | 19 / 20 Passed |