external-model-validation

Use when validating an existing prognostic risk signature on an external bulk expression cohort with survival outcomes, producing risk scores, Kaplan-Meier curves, risk distribution plots, heatmap, and time-dependent ROC curves. NOT for: model training, feature selection, nomogram construction, calibration analysis, or single-cell data.

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Passed

No findings from the security scan

Quality

Content

76%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable and well-structured with valid reference pointers, but the workflow section lacks explicit validation feedback loops (capping workflow clarity) and some tests/ references are broken.

Suggestions

Add explicit validation checkpoints to the Workflow section (e.g., after Step 2 'If SKILL_SAMPLE_MISMATCH or SKILL_MISSING_COLUMNS: fix inputs and re-run Step 1') to lift the workflow-clarity cap.

Consolidate the '--roc_times is always in years' guidance to one location to reduce repetition across the arguments table, Methods, and Examples.

Fix or remove references to the missing tests/ directory (tests/data/, tests/refresh_example_output.R, tests/output/) referenced in the file table, Testing, and Examples sections.

Dimension	Reasoning	Score
Conciseness	Largely lean with well-organized tables and minimal concept over-explanation, but the '--roc_times always in years' point is repeated three times and the error table embeds trimmable inline fix code.	4 / 5
Actionability	Copy-paste-ready Rscript commands, a full typed arguments table with defaults, concrete CSV input samples, and multiple example blocks covering the common day-follow-up confusion.	5 / 5
Workflow Clarity	Steps 1-4 are sequenced but presented descriptively without explicit validate/fix/retry feedback loops in the workflow itself; as a batch-output skill this triggers the workflow-clarity cap of 3.	3 / 5
Progressive Disclosure	SKILL.md is a clear overview with a well-signaled one-level-deep 'When to Read External Files' table pointing to real bundle files, but several referenced tests/ paths do not exist in the bundle.	4 / 5
	Total	16 / 20 Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, well-triggered, and clearly scoped with both positive and negative guidance in third-person voice. Its only gap is modest trigger-term breadth (no file extensions/synonyms).

Dimension	Reasoning	Score
Specificity	Lists multiple concrete outputs ('risk scores, Kaplan-Meier curves, risk distribution plots, heatmap, and time-dependent ROC curves') plus a clear validating action, matching the comprehensive-coverage anchor.	5 / 5
Completeness	Explicitly answers both 'what' (the enumerated outputs) and 'when' ('Use when validating an existing prognostic risk signature...') with concrete triggers, plus a NOT-for list.	5 / 5
Trigger Term Quality	Strong natural terms ('external bulk expression cohort', 'survival outcomes', 'Kaplan-Meier', 'ROC curves') but lacks file extensions and some synonyms, so not the fully comprehensive anchor.	4 / 5
Distinctiveness Conflict Risk	A clear niche (external validation of a fixed prognostic signature) reinforced by an explicit negative-scope list, minimizing overlap with training/nomogram/single-cell skills.	5 / 5
	Total	19 / 20 Passed

Validation

93%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

Criteria	Description	Result
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning

	Total	15 / 16 Passed

Repository: aipoch/medical-research-skills
Path: awesome-med-research-skills/Data Analysis/external-model-validation/SKILL.md
Commit: f5ef65b

Reviewed: ~11 hours ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.