Content
77%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-structured, highly actionable single-file skill whose domain-specific gotchas and validation documentation are excellent. Its main weaknesses are verbosity (padded gotcha paragraphs, inline full citations, time-sensitive probe statistics and dates) and a monolithic structure that inlines detail which belongs in separate reference files.
Suggestions
Trim Gotchas 6 and 8 into short rule statements and move the supporting measurements (probe counts, per-dataset disagreement tallies, cache-key history) into a references/gotcha-details.md file.
Move the full Sun 2018 citation out of the 'Do NOT fire when' bullet into the existing Citations section, keeping only the actionable guidance (pass molecular_trait_id for QTD000584, use ukb-ppp-region-fetch for UKB-PPP) inline.
Replace time-sensitive inline dates (HTTP 410 since September 2026, probed 2026-09-13, measured 2026-10-22) with version-stable statements or collect them in a 'deprecated / upstream status' section, and split the example-output block into an examples/ reference file.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The core content (gotchas on strand-aware cis-windows, ALT-effect beta, duplicate-rsid collapsing) is genuinely non-obvious domain knowledge, but several passages are heavily padded: a full inline citation for Sun 2018 (doi, PMID, author list) in the Trigger section, cache-probing statistics ('33 of 758 probed 2026-09-13', 'measured 2026-10-22, 0 of 468 repeated keys disagreed (82 in the SORT1 QTD000276 window, 311 in QTD000609, 75 in QTD000269 .cc)'), and time-sensitive dates (HTTP 410 'since September 2026') not placed in a deprecated section, which the rubric explicitly penalizes. Gotchas 6 and 8 are 200+ word run-on paragraphs that could be tightened substantially. | 3 / 5 |
Actionability | The CLI Reference gives copy-paste-ready commands covering standard usage, the bundled demo, demo listing, and the ClawBio runner variant, plus a concrete JSON config schema and realistic example output (manifest.yaml, variants.tsv, collapsed_rows.tsv, report.md). Fully executable guidance with specific examples covering the common cases. | 5 / 5 |
Workflow Clarity | The 5-step workflow (resolve dataset_id -> pick region -> tabix range fetch -> filter by molecular_trait_id -> write outputs) is clearly sequenced with concrete commands, and validation is explicit and thorough: every row is checked against the 19 expected columns with EQTLCatalogueSchemaError naming the file and bad row, the CLI exits 2 and writes nothing on failure, duplicate-stat conflicts raise EQTLCatalogueDuplicateRowConflict, and the invariant 'n_variants + len(collapsed) == n_rows_read is checked, not assumed'. No validation cap applies. | 5 / 5 |
Progressive Disclosure | Sections are well-organized with clear headers, but everything lives in one ~186-line monolithic SKILL.md: the enormous Gotcha 6 and 8 paragraphs, the full example-output dumps, and the citation detail are content that clearly belongs in separate reference files. Referenced bundle paths (data/dataset_index_r7.tsv, examples/input.json, eqtl_catalogue_region_fetch.py) are not present in the bundle to verify, and no dedicated reference files carry any of the detail. | 3 / 5 |
Total | 16 / 20 Passed |