CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

arxiv-preflight

Run a submission-readiness preflight on a manuscript before arXiv upload. Use when the user is preparing an arXiv submission, asks to check a paper before uploading, mentions hallucinated or fake references, leftover LLM meta-comments / prompts in text, placeholder data (TODO, TBD, XX%), AI-use disclosure, scholarly integrity, research integrity, or arXiv moderation risk — even if they don't say "preflight". Also trigger on phrases like "check my paper before arXiv", "verify my references", "scan for AI artifacts", "scan for LLM residue", "is my submission ready", or "review .tex/.bib before submit".

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered skill body: an 8-step workflow with explicit risk levels, decision rules, and error-handling for network failure, backed by real scripts and well-signaled one-level-deep references. The main improvement room is in the two 4-scored dimensions: adding example CLI invocations for the scripts and trimming the platform-neutral paragraph.

Suggestions

Add copy-paste-ready command lines (with typical arguments, e.g. `python scripts/scan_ai_artifacts.py manuscript.json`) to each workflow step that names a script, lifting actionability to fully executable.

Trim or move the platform-neutral paragraph ("This skill is intentionally platform-neutral... does not require OpenAI-specific UI metadata") — it is provenance context rather than instructions for executing the skill.

Optionally condense the doubled framing around disclosure calibration in step 6, since the same pointer to references/arxiv_policy_notes.md appears twice.

DimensionReasoningScore

Conciseness

The body is lean and skill-specific — calibration rules like "Minimise false positives at the cost of recall... a false BLOCKER is more costly than a missed LOW" earn their tokens. Minor trimmable padding remains ("This skill is intentionally platform-neutral... it does not require OpenAI-specific UI metadata"), keeping it just below the every-token-earns-its-place anchor.

4 / 5

Actionability

Every workflow step names a concrete script (scripts/extract_manuscript_text.py, scripts/scan_ai_artifacts.py, scripts/verify_references.py, scripts/generate_preflight_report.py) and describes its output (manuscript.json with sections, figures, tables, cite_keys, numbers, warnings). Guidance is executable but stops short of copy-paste-ready command lines with arguments and flags, so it sits between the 4- and 5-anchors.

4 / 5

Workflow Clarity

Eight clearly sequenced steps with explicit checkpoints and error recovery: "Treat unresolved or skipped includes as review risks", "If network is unavailable, mark this section INCOMPLETE rather than skipping silently", plus a Decision Rule checklist (BLOCKER→HOLD, HIGH/MEDIUM→PASS_WITH_FIXES, LOW→PASS) and never-upgrade/never-soften severity guidance. The workflow is read-only analysis, so the destructive-operation cap does not apply.

5 / 5

Progressive Disclosure

The body is a concise overview with four one-level-deep reference files (arxiv_policy_notes.md, ai_artifact_patterns.md, reference_verification.md, report_template.md — all present on disk and correctly cited) plus a dedicated "When to read which reference" section mapping each file to a specific situation, which is exactly the well-signaled navigation the top anchor describes.

5 / 5

Total

18

/

20

Passed

Description

95%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it clearly states what the skill does and when to use it, with unusually thorough natural-language trigger coverage including synonyms and file extensions. The only minor gap is that the capability list reads as detection scope rather than a set of distinct concrete actions.

DimensionReasoningScore

Specificity

The description opens with one concrete action ("Run a submission-readiness preflight on a manuscript before arXiv upload") and enumerates specific detection targets ("hallucinated or fake references, leftover LLM meta-comments / prompts in text, placeholder data (TODO, TBD, XX%), AI-use disclosure"). It lists several specific capabilities but frames them as detection scope rather than the multiple discrete actions of the 5-anchor, so 4 fits best.

4 / 5

Completeness

"Run a submission-readiness preflight on a manuscript before arXiv upload" explicitly answers what, and "Use when the user is preparing an arXiv submission, asks to check a paper before uploading, mentions..." explicitly answers when with concrete trigger phrases, mirroring the 5-anchor structure.

5 / 5

Trigger Term Quality

It covers natural trigger phrases ("check my paper before arXiv", "verify my references", "scan for AI artifacts", "is my submission ready", "review .tex/.bib before submit"), synonyms (hallucinated/fake references, scholarly/research integrity), and file extensions (.tex/.bib) — comprehensive coverage matching the top anchor.

5 / 5

Distinctiveness Conflict Risk

A clear niche (pre-upload arXiv submission review) with distinct, domain-anchored triggers; minimal overlap risk with generic reference-checking or linting skills.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

aipoch/medical-research-skills

Path

awesome-med-research-skills/Academic Writing/arxiv-preflight/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.