CtrlK
BlogDocsLog inGet started
Tessl Logo

automated-soap-note-generator

Generate structured SOAP notes from clinical narratives, transcripts, or existing notes; use when the user needs de-identified clinical documentation organized into Subjective, Objective, Assessment, and Plan sections, with clear assumptions and review points.

63

Quality

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

SKILL.md
Quality
Evals
Security

Quality

Content

50%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is well-structured and gives some executable CLI commands, but it is over-long with redundant sections and its Python examples document a fictional API (scripts.soap_generator) that does not match the bundled scripts/main.py. It also fails to point readers to the existing reference files, leaving large detail inline.

Suggestions

Replace the Python examples that import from the nonexistent scripts.soap_generator with the real scripts/main.py API (generate, extract_entities, extract_vital_signs, detect_negation) so the code is copy-paste executable against the bundle.

Consolidate the overlapping trigger/scope sections (When to Use, When Not to Use, Input Validation, Required Inputs) and the overlapping output/error sections (Output Requirements, Output Contract, Response Template, Error Handling, Failure Handling) to cut redundancy and roughly halve the length.

Move the detailed NER, temporal-extraction, classification-rule, and export-format tables into the existing references/*.md files and link to them from SKILL.md so progressive disclosure is one level deep and navigable.

DimensionReasoningScore

Conciseness

The ~410-line body is mostly efficient per-section but padded overall: redundant overlapping sections ("When to Use"/"When Not to Use"/"Input Validation"/"Required Inputs"; "Output Requirements"/"Output Contract"/"Response Template"; "Error Handling"/"Failure Handling") and conceptual explanations of NER, negation, and temporal extraction that an intelligent model largely already knows. Not a score of 3 because verbosity is not fully eliminated; not a 1 because individual sections are not padded with introductory fluff.

2 / 3

Actionability

Provides some executable guidance ("python scripts/main.py --help" and the self-contained audit command run against the real main.py), but the bulk of the Python examples import "from scripts.soap_generator import SOAPNoteGenerator" — a module that does not exist in the bundle — and call methods (generate_from_transcript, extract_medical_entities, classify_soap_sections, extract_temporal_info, analyze_certainty, generate_soap_document) absent from scripts/main.py, whose real API is generate, generate_from_audio, extract_entities, extract_vital_signs, detect_negation. Not a 3 because the code is not copy-paste executable against the real bundle; not a 1 because the CLI commands and parameter tables do give some concrete, usable guidance.

2 / 3

Workflow Clarity

The Workflow section gives a 5-step sequence with an explicit fallback path, and Quick Check/Audit-Ready Commands supply validation entry points, but the main workflow lacks an integrated validate→fix→retry feedback loop (validation appears only as a separate "Quick Validation" checklist), and the body itself admits transcript/audio paths are unimplemented. Not a 3 because checkpoints are not fully wired into the sequence with error-recovery loops; not a 1 because the steps are clearly sequenced and a fallback is stated.

2 / 3

Progressive Disclosure

Bundle files exist (references/clinical_guidelines.md, medical_terminology.md, sample_soap_notes.md, scripts/main.py) but the body never signals or links any of them, and all detail (NER tables, temporal extraction, classification rules, export formats, output template) is inlined into SKILL.md rather than offloaded — matching the anchor for content that should be separate being inline plus references present but not clearly signaled. Not a 3 because references are neither linked nor one-level-deep navigable; not a 1 because the body is section-organized rather than a monolithic wall of text.

2 / 3

Total

8

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise, specific, and complete — it states concrete actions, natural trigger terms, and an explicit 'use when' clause in third person. It is a strong model description with no over-claims or padding.

DimensionReasoningScore

Specificity

Lists multiple concrete actions and inputs: "Generate structured SOAP notes from clinical narratives, transcripts, or existing notes" and output "organized into Subjective, Objective, Assessment, and Plan sections" — matching the anchor for multiple specific concrete actions.

3 / 3

Completeness

Explicitly answers both what ("Generate structured SOAP notes...") and when ("use when the user needs de-identified clinical documentation organized into Subjective, Objective, Assessment, and Plan sections"), satisfying the highest completeness anchor.

3 / 3

Trigger Term Quality

Covers natural terms a user would say — "clinical narratives, transcripts, or existing notes", "de-identified clinical documentation", "SOAP notes", and the four SOAP section names — giving good coverage of natural trigger vocabulary.

3 / 3

Distinctiveness Conflict Risk

Targets a clear niche (de-identified clinical SOAP documentation) with distinct, domain-specific triggers unlikely to collide with unrelated skills.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
aipoch/medical-research-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.