arxiv

Search, download, and summarize academic papers from arXiv. Use when user says "search arxiv", "download paper", "fetch arxiv", "arxiv search", "get paper pdf", or wants to find and save papers from arXiv to the local paper library.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Low

Low-risk findings worth noting

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, largely executable skill body with an exemplary validated workflow for batch downloads. Its weaknesses are modest: duplicated script-resolution boilerplate, two pseudocode spots, and reference-grade fallback content inlined in SKILL.md.

Suggestions

Factor the ARIS script-resolution cascade into a single shared snippet or reference file and reference it from both Step 2 and Step 6 instead of duplicating ~15 lines verbatim.

Complete the truncated Step 3 inline fallback (replace "# print full details ..." with real code) and rewrite Step 6's "for each arxiv_id in results:" as valid shell syntax so every code block is executable.

Move the large inline Python search fallback (and the resolution-chain details) into a scripts/ or references/ bundle file, keeping SKILL.md as a lean overview with clearly signaled one-level-deep links.

Dimension	Reasoning	Score
Conciseness	The body is efficient — functional code and commands with zero concept explanation — but the ~15-line ARIS resolution cascade is duplicated nearly verbatim in Steps 2 and 6, and the Constants "Overrides" block restates Step 1's directive parsing.	4 / 5
Actionability	Primary paths are copy-paste ready (fetcher invocation, complete inline Python search fallback, download with User-Agent and size reporting), but Step 3's fallback truncates at "# print full details ..." and Step 6 embeds "for each arxiv_id in results:" pseudocode inside a bash block.	4 / 5
Workflow Clarity	Seven clearly sequenced steps with explicit validation and feedback loops for the batch/destructive operations: file-size check (>10 KB), 1-second delay, retry once after 5s on HTTP 429, skip-and-report for existing PDFs, and a fallback when the API is unreachable.	5 / 5
Progressive Disclosure	A single self-contained file with clear sections (Constants, Workflow, Key Rules) and clearly signaled one-level-deep links to shared-references/*.md; however, no bundle files exist, the external shared-references links cannot be verified in-bundle, and the inline Python fallback is reference-grade material kept inline.	4 / 5
	Total	17 / 20 Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete actions, explicit third-person voice, and an explicit 'Use when' clause with comprehensive natural trigger phrases. The only weaknesses are minor — a few body-supported capabilities are unmentioned and one trigger phrase is slightly generic.

Dimension	Reasoning	Score
Specificity	"Search, download, and summarize academic papers from arXiv" names the domain plus three concrete actions, but omits capabilities the body delivers (fetch full paper details, research-wiki ingest), leaving minor coverage gaps rather than comprehensive coverage.	4 / 5
Completeness	It explicitly answers both "what" (search, download, and summarize arXiv papers) and "when" ("Use when user says" followed by concrete quoted trigger phrases), matching the top anchor's form.	5 / 5
Trigger Term Quality	The quoted triggers "search arxiv", "download paper", "fetch arxiv", "arxiv search", "get paper pdf", and "find and save papers from arXiv" comprehensively cover natural phrasings, variations, and synonyms a user would actually say.	5 / 5
Distinctiveness Conflict Risk	The arXiv niche is clear and mostly distinct, but generic phrases like "download paper" carry minor overlap risk with sibling literature skills such as /research-lit.	4 / 5
	Total	18 / 20 Passed

Validation

81%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

Criteria	Description	Result
allowed_tools_field	'allowed-tools' contains unusual tool name(s)	Warning
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning
relative_links	Relative link issues: 4 suspicious	Warning

	Total	13 / 16 Passed

Repository: wanshuiyin/Auto-claude-code-research-in-sleep
Path: skills/arxiv/SKILL.md
Commit: 2132036

Reviewed: 4 days ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.