arxiv-preflight

Run a submission-readiness preflight on a manuscript before arXiv upload. Use when the user is preparing an arXiv submission, asks to check a paper before uploading, mentions hallucinated or fake references, leftover LLM meta-comments / prompts in text, placeholder data (TODO, TBD, XX%), AI-use disclosure, scholarly integrity, research integrity, or arXiv moderation risk — even if they don't say "preflight". Also trigger on phrases like "check my paper before arXiv", "verify my references", "scan for AI artifacts", "scan for LLM residue", "is my submission ready", or "review .tex/.bib before submit".

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Passed

No findings from the security scan

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality, well-organized instruction skill with a clear sequenced workflow, strong validation checkpoints, and exemplary progressive disclosure into real reference/script files. The only minor gap is that script invocations are described rather than given as copy-paste command lines.

Dimension	Reasoning	Score
Conciseness	Lean and efficient throughout — it assumes Claude's competence, never explains basic concepts (what a citation or PDF is), and every section (Workflow, Risk levels, Decision rule, Rules, MVP scope) earns its place.	5 / 5
Actionability	It names concrete scripts with their outputs and references (e.g. 'Run scripts/extract_manuscript_text.py ... Output: manuscript.json'), but the body describes invocations rather than showing copy-paste-ready command lines with flags, leaving minor execution gaps.	4 / 5
Workflow Clarity	An explicit 8-step numbered sequence with validation checkpoints ('If network is unavailable, mark this section INCOMPLETE rather than skipping silently', treat unresolved includes as risks) and feedback loops via the decision rule and never-upgrade/never-soften rules.	5 / 5
Progressive Disclosure	Clear overview with well-signaled one-level-deep references — four real reference files and four real scripts are mapped in a 'When to read which reference' section, and content is appropriately split (patterns, policy, verification, template each in their own file).	5 / 5
	Total	19 / 20 Passed

Description

90%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, well-structured description that clearly states what it does and when to use it, with rich natural-language trigger phrases. The only mild weakness is that the description front-loads trigger contexts rather than enumerating several concrete capabilities.

Dimension	Reasoning	Score
Specificity	The description names the domain ('submission-readiness preflight on a manuscript before arXiv upload') with one concrete action, but lists many trigger contexts rather than several distinct concrete capabilities — the specifics live in the body, not the description.	3 / 5
Completeness	It explicitly answers both what ('Run a submission-readiness preflight... before arXiv upload') and when ('Use when the user is preparing an arXiv submission...', 'Also trigger on phrases like...') with concrete trigger phrases.	5 / 5
Trigger Term Quality	Comprehensive natural phrases including synonyms and file extensions — 'check my paper before arXiv', 'verify my references', 'scan for AI artifacts', 'review .tex/.bib before submit', and concrete markers like 'XX%', 'TODO', 'TBD'.	5 / 5
Distinctiveness Conflict Risk	A narrow arXiv-submission-readiness niche with distinct triggers (hallucinated references, LLM residue, placeholder data, arXiv moderation risk) that minimize overlap with other skills.	5 / 5
	Total	18 / 20 Passed

Validation

93%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

Criteria	Description	Result
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning

	Total	15 / 16 Passed

Repository: aipoch/medical-research-skills
Path: awesome-med-research-skills/Academic Writing/arxiv-preflight/SKILL.md
Commit: f5ef65b

Reviewed: ~8 hours ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.