CtrlK
BlogDocsLog inGet started
Tessl Logo

retraction-watcher

Automatically scan reference lists and check whether cited papers have been retracted, corrected, or flagged; use before submission, review, or evidence synthesis to reduce citation risk.

56

Quality

64%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./scientific-skills/Evidence Insight/retraction-watcher/SKILL.md
SKILL.md
Quality
Evals
Security

Source: https://github.com/aipoch/medical-research-skills

Retraction Watcher

A specialized skill for identifying retracted, corrected, or questionable papers in academic reference lists before they compromise research integrity.

Quick Check

Use this command to verify that the packaged script entry point can be parsed before deeper execution.

python -m py_compile scripts/main.py

Audit-Ready Commands

Use these concrete commands for validation. They are intentionally self-contained and avoid placeholder paths.

python -m py_compile scripts/main.py
python scripts/main.py --help

When to Use

  • Use this skill when the task needs Automatically scan document reference lists and check against Retraction.
  • Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format.
  • Use this skill when you need a documented fallback path for missing inputs, execution errors, or partial evidence.

Workflow

  1. Confirm the user objective, required inputs, and non-negotiable constraints before doing detailed work.
  2. Validate that the request matches the documented scope and stop early if the task would require unsupported assumptions.
  3. Use the packaged script path or the documented reasoning path with only the inputs that are actually available.
  4. Return a structured result that separates assumptions, deliverables, risks, and unresolved items.
  5. If execution fails or inputs are incomplete, switch to the fallback path and state exactly what blocked full completion.

Purpose

Academic misconduct and errors can lead to paper retractions. Citing retracted work undermines research credibility. This skill:

  • Scans reference lists from manuscripts, papers, or bibliographies
  • Cross-checks citations against Retraction Watch and other retraction databases
  • Identifies papers with retraction notices, expressions of concern, or corrections
  • Provides detailed reports with retraction reasons and dates

Trigger Conditions

Activate this skill when:

  1. User provides a document with references and asks to check for retractions
  2. User explicitly requests "check my references" or "scan for retracted papers"
  3. User submits a bibliography or reference list for verification
  4. Pre-submission manuscript review is requested
  5. User wants to verify citation integrity

Input Format

Accepted inputs:

  • PDF files (manuscripts, papers, theses)
  • Plain text files (.txt, .bib, .ris)
  • Raw text containing reference lists
  • URLs to papers or reference lists
  • Clipboard content with citations

Output Format

Report Header

🔍 RETRACTION WATCH REPORT
Documents Scanned: [N]
References Found: [N]
Check Date: [YYYY-MM-DD]

Status Categories

🔴 RETRACTED - Paper has been officially retracted

  • Reason for retraction
  • Retraction date
  • Original DOI/PMID
  • Recommended action: Remove citation

🟡 EXPRESSION OF CONCERN - Journal has raised concerns

  • Nature of concern
  • Date issued
  • Recommended action: Verify current status, consider alternative sources

🟠 CORRECTED - Paper has published corrections/errata

  • Correction details
  • Date of correction
  • Recommended action: Check if correction affects cited claims

🟢 CLEAR - No retraction issues found

Technical Approach

Citation Parsing Strategy

  1. Format Detection: Identify citation style (APA, MLA, Vancouver, Chicago, etc.)
  2. Field Extraction: Parse DOI, PMID, title, authors, journal, year
  3. Identifier Resolution: Normalize DOIs (remove prefixes, validate format)
  4. Title Matching: Extract article titles for fuzzy matching

Database Checking

  1. Retraction Watch Database - Primary source for retraction data
  2. Crossref API - Retraction metadata via "update-type: retraction"
  3. PubMed API - Retraction notices via publication type filters
  4. Open Retractions - Aggregated retraction data

Matching Algorithm

  • Exact Match: DOI/PMID exact match (highest confidence)
  • Title Match: Normalized title comparison (90%+ similarity threshold)
  • Author + Year: Secondary verification for ambiguous matches
  • Fuzzy Matching: Handle minor title variations and typos

Difficulty Level

Medium-High - Requires:

  • Robust citation parsing across multiple formats
  • API integration with retraction databases
  • Handling of partial/incomplete citation data
  • Fuzzy matching for title-based lookups
  • Rate limiting and caching for API calls

Quality Criteria

A successful scan must:

  • Parse >90% of citations correctly from standard formats
  • Achieve <1% false positive rate on retraction detection
  • Provide actionable recommendations for each flagged citation
  • Handle missing DOIs/PMIDs via title matching fallback
  • Complete checks within reasonable time (<30s for 50 references)
  • Preserve reference numbering for easy identification

Limitations

  • Requires internet connection for database lookups
  • Rate limits may apply to free API tiers
  • Very recent retractions (<48 hours) may not be indexed
  • Title-only matching may produce false positives with similar titles
  • Non-English papers may have limited coverage
  • Preprint citations (arXiv, bioRxiv) typically not tracked for retractions

Example Usage

# Check a PDF manuscript
python scripts/main.py --input manuscript.pdf --format detailed

# Check a BibTeX file
python scripts/main.py --input references.bib --output report.txt

# Check raw text
python scripts/main.py --text "[paste references here]"

# Quick check with summary only
python scripts/main.py --input paper.pdf --format summary

Data Sources

References

See references/ for:

  • citation-formats.md: Supported citation format specifications
  • api-documentation.md: Database API reference and rate limits
  • example-reports/: Sample output reports for testing

Author: AI Assistant
Version: 1.0
Last Updated: 2026-02-06
Status: Ready for use
Requires: Internet connection for database lookups

Risk Assessment

Risk IndicatorAssessmentLevel
Code ExecutionPython scripts with toolsHigh
Network AccessExternal API callsHigh
File System AccessRead/write dataMedium
Instruction TamperingStandard prompt guidelinesLow
Data ExposureData handled securelyMedium

Security Checklist

  • No hardcoded credentials or API keys
  • No unauthorized file system access (../)
  • Output does not expose sensitive information
  • Prompt injection protections in place
  • API requests use HTTPS only
  • Input validated against allowed patterns
  • API timeout and retry mechanisms implemented
  • Output directory restricted to workspace
  • Script execution in sandboxed environment
  • Error messages sanitized (no internal paths exposed)
  • Dependencies audited
  • No exposure of internal service architecture

Prerequisites

# Python dependencies
pip install -r requirements.txt

Evaluation Criteria

Success Metrics

  • Successfully executes main functionality
  • Output meets quality standards
  • Handles edge cases gracefully
  • Performance is acceptable

Test Cases

  1. Basic Functionality: Standard input → Expected output
  2. Edge Case: Invalid input → Graceful error handling
  3. Performance: Large dataset → Acceptable processing time

Lifecycle Status

  • Current Stage: Draft
  • Next Review Date: 2026-03-06
  • Known Issues: None
  • Planned Improvements:
    • Performance optimization
    • Additional feature support

Output Requirements

Every final response should make these items explicit when they are relevant:

  • Objective or requested deliverable
  • Inputs used and assumptions introduced
  • Workflow or decision path
  • Core result, recommendation, or artifact
  • Constraints, risks, caveats, or validation needs
  • Unresolved items and next-step checks

Error Handling

  • If required inputs are missing, state exactly which fields are missing and request only the minimum additional information.
  • If the task goes outside the documented scope, stop instead of guessing or silently widening the assignment.
  • If scripts/main.py fails, report the failure point, summarize what still can be completed safely, and provide a manual fallback.
  • Do not fabricate files, citations, data, search results, or execution outcomes.

Input Validation

This skill accepts requests that match the documented purpose of retraction-watcher and include enough context to complete the workflow safely.

Do not continue the workflow when the request is out of scope, missing a critical input, or would require unsupported assumptions. Instead respond:

retraction-watcher only handles its documented workflow. Please provide the missing required inputs or switch to a more suitable skill.

References

  • references/audit-reference.md - Supported scope, audit commands, and fallback boundaries

Response Template

Use the following fixed structure for non-trivial requests:

  1. Objective
  2. Inputs Received
  3. Assumptions
  4. Workflow
  5. Deliverable
  6. Risks and Limits
  7. Next Checks

If the request is simple, you may compress the structure, but still keep assumptions and limits explicit when they affect correctness.

When Not to Use

  • Do not proceed when required input files, identifiers, parameters, or context are missing — ask the user to provide them first.
  • Do not assume capabilities beyond this skill's declared scope when the user requests external operations or inferences.
  • Do not proceed without user confirmation when overwriting existing results, executing high-cost batch operations, or expanding task scope.

Required Inputs

FieldRequiredFormat/SourceExampleIf Missing
User task descriptionYesTextResearch question, writing goal, analysis objectiveStop and ask user to provide
Primary input materialDepends on taskText, file path, ID, table, or literaturePMID, PDF, CSV, DOCX, keywords, etc.Specify which material type is missing
Output preferenceNoTextLanguage, format, target journal, templateUse skill default format

Output Contract

  • Primary output: Structured result or target file aligned with this skill's objective.
  • Optional output: Intermediate check notes, issue list, supplementary suggestions, or generated file paths.
  • Format requirement: Unless the user specifies otherwise, prefer stable, reviewable Markdown or JSON; if the skill's bundled script requires a fixed format, use that format.
  • If partially complete: Must explicitly mark as PARTIAL and state which steps are completed and which remain.

Failure Handling

  • Missing critical input: Explicitly state which fields, files, or identifiers are missing and pause.
  • Script, template, or resource execution failure: Report the failing step, likely cause, and recovery suggestions — do not silently degrade.
  • Partial completion only: Return the verified portion first, then list remaining blockers and suggested next steps.

User Checkpoints

  • Before executing batch processing, overwriting files, long-running searches, or multi-stage generation, confirm scope and output format with the user.
  • Before proceeding when a key judgment is ambiguous, evidence is insufficient, or the workflow is entering the next stage, confirm with the user.

Quick Validation

  • Check that key scripts, templates, or reference file paths this skill depends on exist.
  • Check that the final output contains the core fields, sections, or files specified for this task.
  • Check that results clearly mark assumptions, limitations, and incomplete items.
Repository
aipoch/medical-research-skills
Last updated
First committed

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.