CtrlK
BlogDocsLog inGet started
Tessl Logo

tooluniverse-diagnostic-test-evaluation

Diagnostic test / biomarker accuracy — sensitivity, specificity, PPV, NPV, likelihood ratios, accuracy from a 2x2 table; ROC curve, AUC, and the optimal cutoff (Youden) for a continuous biomarker; and post-test probability via Bayes. Use when you have test results vs a gold standard (binary 2x2, or a continuous score + true labels) and need to judge how good the test is, pick a threshold, or compute the probability of disease given a result. Emphasizes the prevalence-dependence of PPV/NPV.

72

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is tooluniverse-diagnostic-test-evaluation in mims-harvard/ToolUniverse

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable and well-structured with executable commands and a clear case-routing table. It is slightly held back by the absence of explicit validation feedback loops and minor verbosity in the gotchas.

Suggestions

Add an explicit validation/checkpoint step for the ROC analysis (e.g., confirm both classes are present and report PPV at the real prevalence before quoting AUC) to strengthen the workflow's feedback loop.

Tighten the 'PPV/NPV trap' callout and Gotchas into shorter bullets to trim a few tokens without losing the key warnings.

Consider splitting the long metric-definition table in Step 1 into a short inline summary with the full reference one level deeper, improving progressive disclosure.

DimensionReasoningScore

Conciseness

Lean and mostly efficient with dense, high-value tables and executable commands; the 'PPV/NPV trap' callout and Gotchas section are slightly expansive but earn their tokens, leaving minor trimming possible.

4 / 5

Actionability

Fully executable guidance throughout — concrete `tu run` commands with complete JSON payloads, the `ROC_analysis(...)` MCP form with inline args, and a real bundled CLI script — copy-paste ready and covering the common cases.

5 / 5

Workflow Clarity

A clear decision-table routes to sequenced Step 1/2/3 branches, but there are no explicit validate-then-fix feedback checkpoints for the statistical/batch operations, leaving minor validation gaps.

4 / 5

Progressive Disclosure

Well-organized single-file overview with a one-level-deep bundled reference (scripts/roc_analysis.py, verified present) clearly signaled; structure is good though the body is denser than the simple-skill exception envisions.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, trigger-rich, and explicitly answers both 'what' and 'when', with a clear distinct niche. It is a strong, well-targeted skill description.

DimensionReasoningScore

Specificity

Lists multiple concrete actions across all three modes — 'sensitivity, specificity, PPV, NPV, likelihood ratios, accuracy from a 2x2 table', 'ROC curve, AUC, and the optimal cutoff (Youden)', and 'post-test probability via Bayes' — giving comprehensive coverage.

5 / 5

Completeness

Clearly states what it does (the metrics it computes) and gives an explicit trigger clause — 'Use when you have test results vs a gold standard... and need to judge how good the test is, pick a threshold, or compute the probability of disease given a result.'

5 / 5

Trigger Term Quality

Strong natural-term coverage (diagnostic test, biomarker, sensitivity, specificity, PPV, NPV, ROC, AUC, cutoff) including synonyms, but a few common lay phrasings users might say are absent, keeping it just below comprehensive.

4 / 5

Distinctiveness Conflict Risk

Occupies a clear diagnostic-accuracy/biomarker niche with distinct, specific triggers and minimal overlap risk with adjacent statistical skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
mims-harvard/ToolUniverse
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.