arxiv

Search arXiv papers by keyword, author, category, or ID.

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./skills/research/arxiv/SKILL.md

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is highly actionable and well-structured with a clear end-to-end workflow and a real helper script, scoring strongly across the board. The main improvement is splitting the Semantic Scholar reference into its own file to reduce inline bulk.

Dimension	Reasoning	Score
Conciseness	The body is mostly dense, executable reference material (curl commands, tables, parsing snippets) with little concept over-explanation, though the two inlined API references and inline Python parsers could be trimmed or offloaded.	4 / 5
Actionability	Copy-paste-ready curl commands and complete Python parsing snippets cover the common cases (search, fetch by ID, BibTeX, citations) with specific, executable examples.	5 / 5
Workflow Clarity	The 'Complete Research Workflow' gives a clear 7-step sequence and the Withdrawn Papers section acts as a validity checkpoint; minor validation gaps remain but operations are read-only so the destructive-cap does not apply.	4 / 5
Progressive Disclosure	Section headers are clear and the referenced scripts/search_arxiv.py is a real one-level-deep bundle file, but two full API references (arXiv + Semantic Scholar) are inlined rather than split into separate reference files.	4 / 5
	Total	17 / 20 Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, third-person, and clearly distinct, but lacks an explicit 'when to use' trigger clause, which caps its completeness. Adding a 'Use when...' sentence would lift the weakest dimension.

Suggestions

Add a 'Use when...' clause naming concrete user triggers, e.g. "Use when searching arXiv for papers by topic, author, or category, or retrieving a paper by ID."

Include a couple of natural synonyms ("preprints", "research papers", "academic papers") to broaden trigger-term coverage.

Optionally mention retrieval/output actions (fetch metadata, generate BibTeX) to round out the capability list.

Dimension	Reasoning	Score
Specificity	"Search arXiv papers by keyword, author, category, or ID" lists several concrete search facets rather than a single generic action, though it stops short of naming retrieval/output actions.	4 / 5
Completeness	It states clearly what the skill does but provides no "Use when..." clause or equivalent explicit trigger guidance, so completeness is capped at 3 per the rubric guideline.	3 / 5
Trigger Term Quality	Includes natural terms users say ("arXiv", "papers", "keyword", "author", "category", "ID") with good coverage, but misses common synonyms like "preprints" or "research papers".	4 / 5
Distinctiveness Conflict Risk	"Search arXiv papers" carves out a clear, arXiv-specific niche with distinct triggers and minimal overlap risk with other skills.	5 / 5
	Total	16 / 20 Passed

Validation

81%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

Criteria	Description	Result
metadata_version	'metadata.version' is missing	Warning
metadata_field	'metadata' should map string keys to string values	Warning
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning

	Total	13 / 16 Passed

Repository: NousResearch/hermes-agent
Path: skills/research/arxiv/SKILL.md
Commit: 6680afb

Reviewed: about 3 hours ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.