Content
68%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A highly actionable, well-bundled skill: executable code, real paths, a genuine one-level-deep reference, and a matching script. It loses points for repetition in the data-types section, inline time-sensitive version details, and the absence of post-download validation steps for large batch downloads.
Suggestions
Collapse the per-data-type download examples into one example plus a filepath/shortcut table (the content already exists in both the body and the reference).
Add an explicit verification step after download (e.g. gzip -t or check the first line is a TSV header, not a login page) before parsing.
Move the version/date detail ('v102, May 2025') into the reference or a release-notes section so the main flow stays evergreen.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is mostly functional but noticeably loose: the 'Available Data Types' section repeats the same download_cosmic_file call pattern ~7 times with only the filepath varying, the Overview and reference file restate the same COSMIC boilerplate, and time-sensitive details ('current version: v102, May 2025') sit in the main flow rather than a deprecated/notes section. Not a 2 because almost every section carries real, non-obvious information (file paths, shortcuts, column names). | 3 / 5 |
Actionability | Guidance is fully executable: copy-paste Python calls with real file paths ('GRCh38/cosmic/latest/CosmicMutantExport.tsv.gz'), CLI invocations with flags (--data-type, --assembly, -o), install commands, helper-function signatures with return values, and runnable pandas/pysam analysis snippets. Specific examples cover the common cases (mutations, gene census, fusions, CNA, signatures). | 5 / 5 |
Workflow Clarity | The Quick Start gives a coherent sequence (register → install → download → analyze) and Troubleshooting covers error categories, but there are no explicit validation checkpoints — e.g. verify the downloaded gzip is complete/valid before parsing, or confirm an HTML login-error page wasn't saved as the file. Since multi-GB batch downloads are the core operation, the missing validation/verification cap applies (cannot exceed 3). | 3 / 5 |
Progressive Disclosure | Good structure: SKILL.md is a working overview, the bulk detail lives in a real one-level-deep reference (references/cosmic_data_reference.md, confirmed present) that is clearly signaled with an explicit 'Use this reference when...' list, and scripts/download_cosmic.py exists with the documented functions. Not a 5 because the data-type catalog and file-path lists are duplicated between the body and the reference, so the split is not fully clean. | 4 / 5 |
Total | 15 / 20 Passed |