Content
90%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body is a tight, actionable guide with copy-paste-ready commands for 2x2 metrics, ROC/AUC/Youden, and Bayesian post-test probability, plus valuable gotchas on prevalence-dependence, AUC vs operating point, and class imbalance. Minor room remains for an explicit validate-and-retry note and slightly more file-based disclosure.
Suggestions
Add a short validate/retry checkpoint after Step 2 (e.g. confirm both classes are present and the AUC CI is reasonable before quoting the Youden cutoff), even though the analysis is non-destructive.
Consider moving the metric-definition table or the Gotchas list into a short reference file and linking it from the overview to push progressive disclosure toward a clean one-level-deep split.
State explicitly that Epidemiology_bayesian post-test probability is the source of real-world PPV/NPV right inside Step 3 rather than only in the Step 1 trap note, to make the workflow self-contained at the final step.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Lean and efficient; the metric table is framed as a prevalence-dependence reminder rather than restating basics Claude already knows, and the 'Gotchas'/'Honest limitations' sections each earn their tokens with non-obvious domain guidance. | 5 / 5 |
Actionability | Fully executable guidance across all entry points: complete `tu run …` JSON commands, MCP `ROC_analysis(...)` call signatures with inline and CSV forms, and a real bundled script with documented CSV columns. | 5 / 5 |
Workflow Clarity | A clear 'Which case are you in?' routing table sequences the three steps with cross-links (e.g. Step 2 feeds the chosen cutoff back to Step 1); no explicit error-recovery feedback loop, but the operations are read-only analysis so that cap is not triggered. | 4 / 5 |
Progressive Disclosure | Well-organized overview with an accurately-referenced one-level-deep bundle file (scripts/roc_analysis.py, verified present) and clearly signaled MCP/CLI paths; most detail is inline which is appropriate for the small size, keeping it just shy of the split-file ideal. | 4 / 5 |
Total | 18 / 20 Passed |