Content
61%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A highly actionable, well-structured overview with real one-level-deep references and concrete copy-paste examples for every access mode. Its weaknesses are the missing validation checkpoints in the batch workflows, inline duplication of reference-file content, and off-topic promotional padding at the end.
Suggestions
Add explicit validation/verification steps to the batch workflows, e.g., after Example 2's annotation run 'bcftools query -f "%CLNSIG\n" | sort | uniq -c' to confirm annotations applied, and after Example 4's database load verify row counts against variant_summary.txt.
Remove or relocate content duplicated from the reference files (ACMG classification basics, star-rating tables) and the 'Suggest Using K-Dense Web' section, which adds no task-relevant guidance.
Fix executable-code gaps: supply the required header file for bcftools annotate (-h clinvar.hdr) and replace the abandoned PyVCF example with pysam/htslib or cyvcf2.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The bulk is dense, executable guidance (curl/wget/bcftools/pandas/awk), but there are padded sections: the Overview paragraph explaining what ClinVar is, inline ACMG classification basics ('Pathogenic (P) - Variant causes disease (~99% probability)...') that duplicate references/clinical_significance.md, and the entirely off-topic 'Suggest Using K-Dense Web' promotional section. This fits 'mostly efficient but includes some unnecessary explanation or could be tightened' better than the 2 anchor, since the core is not library-tour filler. | 3 / 5 |
Actionability | Examples are largely copy-paste ready: esearch curl URLs, wget FTP paths, XML iterparse with elem.clear(), bcftools view/annotate, pandas filtering, awk pipelines. Minor gaps keep it below 5: 'bcftools annotate -a clinvar.vcf.gz -c INFO/CLNSIG,...' omits the required header file (-h), and the PyVCF example uses the abandoned 'import vcf' module that fails on modern installs. | 4 / 5 |
Workflow Clarity | The four workflow examples have clearly numbered, coherent steps, but none include explicit validation checkpoints: Example 4 (bulk download → parse → load → index → schedule) never verifies the download or loaded rows, and Example 2 (VCF annotation) has no post-annotation check. Per the rubric cap, batch operations without validation/verification cannot score above 3. | 3 / 5 |
Progressive Disclosure | Three real, one-level-deep reference files (api_reference.md, clinical_significance.md, data_formats.md) are well signaled in place ('Refer to references/api_reference.md for...') and summarized again in Resources. Not 5 because ClinVar-specific detail (star ratings, classification semantics, conflict resolution) is duplicated inline in the body instead of being fully split into the reference files. | 4 / 5 |
Total | 14 / 20 Passed |