CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

tooluniverse-product-safety-surveillance

Post-market safety surveillance and recall/adverse-event RETRIEVAL across the full spectrum of FDA-regulated products that are NOT covered by the drug-AE signal skills: medical devices, food / dietary supplements / cosmetics, veterinary drugs, and drug supply (shortages). Orchestrates openFDA endpoints (MAUDE device adverse events + device recalls + 510(k), CAERS food/supplement/ cosmetic adverse events, veterinary adverse events, drug shortages, and cross-product enforcement/recall reports). USE WHEN the user asks: "are there adverse events for [device / pacemaker / infusion pump / insulin pump]", "device recalls for [firm/product]", "supplement / vitamin / cosmetic adverse reactions", "is [drug] in shortage", "what injectables are on shortage", "veterinary / animal adverse events for [drug] in [dog/cat/horse]", "food recall for listeria", "MAUDE report for [device]", "CAERS reactions for [brand]". DO NOT USE for drug adverse-event SIGNAL detection or disproportionality (PRR / ROR /...

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is tooluniverse-product-safety-surveillance in mims-harvard/ToolUniverse

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality, operator-specific body: exact tool names, verified queries with real hit counts, a critical query-grammar section capturing non-obvious API quirks, and a well-routed workflow with mandatory caveats. The main weakness is duplication between the inline worked examples/field tables and references/openfda_fields.md, plus the absence of an explicit query-failure retry step.

Suggestions

Deduplicate the worked examples: keep 2-3 inline as canonical patterns and move the rest to references/openfda_fields.md, which already repeats all five (pacemaker 16619, Medtronic 1896, ketorolac 799, Cosmetics 52214, carprofen 46469) — this would raise both conciseness and progressive_disclosure.

Add an explicit retry checkpoint to the workflow, e.g. 'If a query errors or returns 0 hits, simplify the value to a single token (drop / ( ) +) and re-run' — currently that recovery guidance is only implicit in the Query Grammar section.

Complete the 'DO NOT USE' list in the frontmatter description, which is truncated at 'PRR / ROR /...', so the boundary with the pharmacovigilance skills is fully stated where trigger decisions are made.

DimensionReasoningScore

Conciseness

No padding or explanations of concepts Claude already knows, and every section carries non-obvious verified facts (e.g. 'Do NOT use +AND+', 'Dates are strings: device AE/MAUDE use YYYYMMDD'). However, the five worked examples and much of the interpretation-table content are duplicated verbatim in references/openfda_fields.md, so a meaningful block of tokens could be trimmed or delegated. Not 5 because of that duplication; not 3 because nothing reads as unnecessary explanation — it is mostly lean, operator-specific detail.

4 / 5

Actionability

Fully executable, copy-paste-ready tool calls with real outputs: 'OpenFDA_search_device_adverse_events {"search":"device.generic_name:pacemaker AND event_type:Death","limit":1}' → 'total = 16619', plus exact field paths ('animal.species:Dog', 'reaction.veddra_term_name') and concrete interpretation of each result. The examples cover the common cases across all product classes. Not 4: there are no gaps — tool names, arguments, expected outputs, and interpretation are all specified.

5 / 5

Workflow Clarity

The 7-step workflow (classify → pick tool → build query → run → interpret → summarize/cite → route out-of-scope) is clearly sequenced with useful checkpoints (read data.meta.results.total, cite query + total, limitations caveat, stop-and-route step 7). Not 5: there is no explicit validate-and-retry loop for failed/empty queries — the recovery advice (simplify the token, avoid special chars) lives in the grammar section rather than as a workflow checkpoint. Not 3: the sequence is complete with most checkpoints explicit; this is retrieval, not a destructive/batch operation, so the validation cap does not apply.

4 / 5

Progressive Disclosure

Good structure: the body is a navigable overview (tool map, grammar, workflow, examples, limitations) with a clearly signaled, real, one-level-deep reference ('See references/openfda_fields.md for the full per-endpoint field reference and additional query examples' — the file exists and matches). Not 5 because the inline interpretation tables and all five worked examples substantially duplicate the reference file, so the split is not clean; not 3 because the reference is well signaled and the core/most-needed content is appropriately inline.

4 / 5

Total

17

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exceptionally dense, well-targeted description: explicit what/when, endpoint-level specificity, and a long list of natural trigger phrases. The only flaws are the truncated 'DO NOT USE' clause and residual ambiguity between raw drug-AE retrieval (in scope) and drug-AE signal work (routed elsewhere).

DimensionReasoningScore

Specificity

Names multiple concrete capabilities across named endpoints: 'Orchestrates openFDA endpoints (MAUDE device adverse events + device recalls + 510(k), CAERS food/supplement/cosmetic adverse events, veterinary adverse events, drug shortages, and cross-product enforcement/recall reports)' — comprehensive, no vague filler.

5 / 5

Completeness

Both 'what' (post-market safety surveillance and recall/adverse-event retrieval across the named product classes and endpoints) and 'when' ('USE WHEN the user asks: ...' with concrete trigger phrases) are explicitly answered, matching the anchor-5 example exactly.

5 / 5

Trigger Term Quality

The 'USE WHEN' clause quotes many natural user phrasings with synonyms: "are there adverse events for [device / pacemaker / infusion pump / insulin pump]", "is [drug] in shortage", "food recall for listeria", "MAUDE report for [device]", "CAERS reactions for [brand]" — comprehensive natural-language coverage. Not below 5: no common variation (device, recall, shortage, supplement, veterinary) is missing; not above because 5 is the max.

5 / 5

Distinctiveness Conflict Risk

The 'DO NOT USE for drug adverse-event SIGNAL detection or disproportionality (PRR / ROR /...' clause carves out a clear niche, but the clause is truncated mid-list and the skill does cover raw FAERS drug-event retrieval ('OpenFDA_search_drug_events'), leaving minor overlap risk with closely related drug-AE skills on plain "adverse events for [drug]" queries. Not 5: the boundary is incompletely stated in the description itself; not 3: the explicit DO-NOT-USE routing goes well beyond 'somewhat specific'.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

mims-harvard/ToolUniverse

Path

plugins/tooluniverse/skills/tooluniverse-product-safety-surveillance/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.