Content
61%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The content is highly actionable with executable, dataset-specific code and clear per-section structure. Its weaknesses are duplicated/inflated code, missing validation checkpoints in batch download workflows, and orphaned bundle scripts that are never surfaced via progressive disclosure.
Suggestions
Reference the existing bundle scripts from the relevant sections (e.g., 'See scripts/download_cosmic.py for the full download workflow') instead of inlining all code.
Add validation checkpoints to the download workflows (e.g., verify file integrity, check expected row counts, handle partial downloads) to lift workflow_clarity above 3.
De-duplicate parse_gmt (it appears in both Quick Start and section 6) and trim debug print() statements to tighten conciseness.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Mostly efficient code with brief comments and no concept padding, but the ~560-line body duplicates parse_gmt (defined in both Quick Start and section 6) and is inflated by debug print() statements that could be trimmed. | 3 / 5 |
Actionability | Provides copy-paste-ready Python functions with real download URLs, file formats, and exact column names across all eight datasets, fully covering common cases. | 5 / 5 |
Workflow Clarity | A Typical Workflows section sequences concrete examples, but large-data batch downloads (COSMIC ~30GB, GTEx ~2GB) have no validation checkpoints or error-recovery feedback loops, which the rubric caps at 3 for batch operations. | 3 / 5 |
Progressive Disclosure | The body is a monolithic ~560-line wall with all code inlined; the provided bundle scripts (scripts/build_ppi_network.py, download_cosmic.py, parse_msigdb.py) exist but are never referenced or linked from the body. | 2 / 5 |
Total | 13 / 20 Passed |