CtrlK
BlogDocsLog inGet started
Tessl Logo

active-comparator-single-soc-faers-safety-comparison

Generates complete FAERS pharmacovigilance study designs for multi-drug or class-level safety comparison inside one predefined SOC or AE family using active comparators, disproportionality analysis, subgroup characterization, and reviewer-facing evidence control.

60

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./awesome-med-research-skills/Protocol Design/active-comparator-single-soc-faers-safety-comparison/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a strongly structured, well-validated planning workflow with exemplary progressive disclosure into a real, complete reference bundle. Its weaknesses are redundancy (duplicated trigger examples, repeated config-table spec, overlapping hard rules) and reliance on references for a few key execution templates.

Suggestions

Delete the 'Sample Triggers' section — it repeats the Input Validation examples verbatim — or replace it with genuinely different example phrasings.

Merge the Step 3 config-table specification with output Section B's requirements (they restate the same fields) and consolidate overlapping Hard Rules (3 with 14, 12 with 15, 13 with 6).

Fix the 'Mandatory Output Sections (A–I, all required)' header to say A–J, since Section J (Self-Critical Risk Review) is also mandatory, and inline at least a one-line summary of the 8 required workflow-step fields so Step 6 is self-contained.

DimensionReasoningScore

Conciseness

The body is dense operational instruction with no concept padding, but contains noticeable redundancy: the 'Sample Triggers' section repeats the four input examples verbatim, Step 3's config-table requirements are restated nearly word-for-word in Section B, and Hard Rules 3/14, 12/15, and 13/6 overlap substantially. This fits 'mostly efficient but could be tightened' rather than the 4 anchor's 'minor instances'.

3 / 5

Actionability

Guidance is concrete throughout: exact valid-input grammar, a pattern-selection table, named workload configs with defined fields, an exact out-of-scope redirect to quote, exact disclaimer line, and per-section output specifications with example formats (dependency map, reference-pack categories). Below 5 because several executable details live only in references (the 8-field step template, figure/deliverable plan — Section E is a bare link), leaving minor gaps in the body itself.

4 / 5

Workflow Clarity

Seven steps 'always run in order' with explicit validation checkpoints and a feedback loop: input validation with a stop-and-redirect rule, the mandatory Step 5 dependency consistency check with 'If any dependency inconsistency is found, revise the plan before outputting', the mandatory Step 4.5 citation-verification rules with fallback behavior when browsing is unavailable, and a 15-item hard-rules checklist. This matches the 5 anchor's clear sequence, explicit validation, and error-recovery loop.

5 / 5

Progressive Disclosure

The body is a well-organized overview with clearly signaled, one-level-deep references ('→ Detailed pattern logic: [references/study-patterns.md]', etc.); all 8 referenced files exist in the bundle with substantive content (41–137 lines each), and no reference chains further into other files, matching the 5 anchor exactly.

5 / 5

Total

17

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific and domain-rich with good natural trigger keywords, clearly communicating a distinctive niche. Its main weakness is the complete absence of a 'when to use' clause, which caps completeness, plus minor padding ('complete', 'reviewer-facing evidence control').

Suggestions

Add an explicit trigger clause, e.g. 'Use when the user asks for a FAERS drug-class or multi-drug safety comparison within one predefined SOC or adverse event family.'

Spell out 'adverse event (AE)' and include common synonyms such as 'signal detection' or 'post-marketing surveillance data' that users naturally say.

Trim over-claiming padding like 'complete' and 'reviewer-facing evidence control' in favor of concrete deliverables (e.g. 'four workload configurations with dependency and evidence-tier maps').

DimensionReasoningScore

Specificity

The description lists several concrete methodological actions — 'using active comparators, disproportionality analysis, subgroup characterization' — grounded in a named domain (FAERS pharmacovigilance study design for 'multi-drug or class-level safety comparison inside one predefined SOC or AE family'). It falls short of the 5 anchor because 'Generates complete... study designs' and 'reviewer-facing evidence control' are mildly padded/over-claiming, while sitting above the 3 anchor by naming more than 1-2 concrete actions.

4 / 5

Completeness

The 'what' is clear (generates FAERS comparative study designs with named methods), but there is no 'Use when...' clause or equivalent explicit trigger guidance — per the judging guidelines this caps completeness at 3. Not 2 because the 'what' is specific and detailed, not vague.

3 / 5

Trigger Term Quality

Strong natural domain keywords users would say: 'FAERS', 'pharmacovigilance', 'safety comparison', 'SOC', 'active comparators', 'disproportionality analysis'. Below 5 because common user phrasings like 'adverse event' (only the abbreviation 'AE' appears), 'signal detection', or 'post-marketing surveillance' are missing.

4 / 5

Distinctiveness Conflict Risk

A clear niche is stated ('multi-drug or class-level safety comparison inside one predefined SOC or AE family' with 'active comparators'), which distinguishes it from generic document or data skills. Below 5 because it belongs to an apparent family of similar FAERS/pharmacovigilance planner skills (whole-profile single-drug designs, etc.), leaving minor overlap risk with closely related siblings.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
aipoch/medical-research-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.