arxiv

Search arXiv papers by keyword, author, category, or ID.

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./skills/research/arxiv/SKILL.md

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-organized reference skill with copy-paste commands and a real helper script, scoring top marks on actionability. The main gaps are the absence of an explicit "Use when"-style trigger in the description and some bulky inline reference material that could be progressively disclosed into separate files.

Suggestions

Move the Semantic Scholar API reference and/or BibTeX generation into separate reference files (e.g. references/citations.md, references/bibtex.md) and link to them from the body to improve progressive disclosure.

Add brief validation/error-recovery notes for the workflow (e.g. handling rate-limit 429s or empty result sets) to push workflow clarity toward 5.

Tighten or link-out the long inline Python parsing snippets to reduce token load.

Dimension	Reasoning	Score
Conciseness	The body is a lean reference of tables and copy-paste commands with little concept over-explanation, but the inline BibTeX parser and the sizable Semantic Scholar section could be trimmed or split, keeping it just below a 5.	4 / 5
Actionability	It provides fully executable, copy-paste-ready curl commands, complete Python parsing snippets, and a documented helper script (scripts/search_arxiv.py) covering the common search/fetch/citation cases, matching the top anchor.	5 / 5
Workflow Clarity	A numbered "Complete Research Workflow" sequences discover → assess → read → relate → recommend → track, and the BibTeX snippet guards "Paper not found"; these are read-only API calls so the destructive-validation cap does not apply, but there are no explicit validate→fix→retry loops for the 5.	4 / 5
Progressive Disclosure	Structure is well organized with clear sections and a real one-level-deep reference to scripts/search_arxiv.py (verified present), but the large inline Semantic Scholar and BibTeX reference material is not split into separate files, so it is not a 5.	4 / 5
	Total	17 / 20 Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A concise, specific description that clearly names the arXiv niche and four search facets, but it lacks any explicit "Use when..." trigger guidance, which caps its completeness. Adding a trigger clause would lift the weakest dimension.

Suggestions

Append a "Use when..." clause, e.g. "Use when the user asks to find, search, or look up arXiv/preprint papers by topic, author, category, or ID."

Add natural synonyms like "preprints", "research papers", and "academic papers" to broaden trigger coverage.

Optionally mention retrieval/reading outcomes (e.g. "and retrieve metadata/abstracts") to round out the capability list.

Dimension	Reasoning	Score
Specificity	"Search arXiv papers by keyword, author, category, or ID" names the domain plus four concrete search modalities, matching the anchor that lists several specific actions with minor coverage gaps; not a 5 because it omits retrieve/read/citation actions.	4 / 5
Completeness	The description gives a clear "what" (search arXiv papers by four facets) but has no "Use when..." clause or equivalent trigger guidance, which per the rubric caps completeness at 3.	3 / 5
Trigger Term Quality	Natural terms like "arXiv", "papers", "keyword", "author", and "category" are present and likely user-spoken, but common synonyms such as "preprints", "research papers", or "academic papers" are missing, so it stops short of comprehensive 5.	4 / 5
Distinctiveness Conflict Risk	"arXiv papers" carves out a clear, narrow niche with distinct triggers and minimal overlap with other skills, matching the anchor for a clear niche with minimal conflict risk.	5 / 5
	Total	16 / 20 Passed

Validation

81%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

Criteria	Description	Result
metadata_version	'metadata.version' is missing	Warning
metadata_field	'metadata' should map string keys to string values	Warning
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning

	Total	13 / 16 Passed

Repository: NousResearch/hermes-agent
Path: skills/research/arxiv/SKILL.md
Commit: 6327930

Reviewed: 3 days ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.