Content
92%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A tight, expert-level skill: the multi-step statistical workflow is fully specified with executable commands, exact formulas, input-validation rules, and error-recovery guidance, and the single helper script is correctly referenced and integrated. The only weakness is mild redundancy with standard meta-analysis knowledge (I² thresholds, fixed-vs-random conventions) that could be trimmed for token efficiency.
Suggestions
Compress the Step 4 I² interpretation table to just the decision-relevant thresholds and the Q p-value rule; Claude already knows the standard 0/25/50/75% heterogeneity bands and 'low/moderate/substantial' labels.
Trim the Step 2 fixed-vs-random table to the decision rule ('unsure → report random-effects') plus the I² heuristic; the conceptual distinction between the models is standard knowledge.
The tau_squared explanation ('between-study variance on the effect scale; > 0 is what random-effects adds over fixed') can be cut to just the role it plays in interpreting output.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and decision-oriented — tables, formulas, exact commands, no tutorial padding — and the high-value pitfalls (log-transform ratios, the scale foot-gun, CI→SE derivation) earn every token. However, the I² interpretation table, the fixed-vs-random effects table, and the tau_squared explanation partly restate standard meta-analysis knowledge Claude already has; trimming these would save tokens without losing skill-specific value. | 4 / 5 |
Actionability | Everything is executable: exact conversion formulas per input type ('(ln(U) − ln(L)) / (2 × 1.96)'), a copy-paste `tu run MetaAnalysis_run` invocation with a complete JSON studies array, the helper script's CSV column schemas, and a worked reporting example with concrete numbers. A user can go from raw paper numbers to a pooled estimate without inventing any step. | 5 / 5 |
Workflow Clarity | A 5-step workflow diagram is stated up front and each step is then elaborated in order, with explicit validation checkpoints: input rules (log-transform, 'one direction', 'same effect measure'), a retraction check before trusting studies, error-recovery guidance ('flip sign / invert the ratio for studies coded the opposite way'), interpretation thresholds for reading results, and an ordered reporting checklist. Not a destructive or unvalidated batch operation — input verification and output interpretation are both built in. | 5 / 5 |
Progressive Disclosure | The bundle is one helper script (verified present at scripts/meta_analysis.py, and its behavior matches the body's claims: ratio log-transformation with back-transformed output, forest plot, publication-bias note). The body is well-sectioned per workflow step with a summary diagram for navigation, the script is well-signaled with its usage inlined, and nothing at this size warrants splitting into reference files — the conversion table that could be a reference is the core error-prone step and belongs inline. | 5 / 5 |
Total | 19 / 20 Passed |