arxiv-search

Search arXiv physics, math, and computer science preprints using natural language queries. Powered by Valyu semantic search.

Quality

72%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

High

Do not use without reviewing

Fix and improve this skill with Tessl

tessl review fix ./skills/literature/arxiv-search/SKILL.md

Quality

Content

72%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is highly actionable with executable commands and a clear setup flow, and is well-organized as a self-contained skill. It loses points on conciseness due to promotional and tangential SDK content, and on workflow clarity for missing explicit validation checkpoints.

Suggestions

Trim the 'Why This Skill is Powerful' hype list and the Python/TypeScript SDK integration section, or move them to a separate reference, to improve token efficiency.

Add an explicit validation checkpoint in the script-path flow (e.g., fail with a clear message if the `search` script is not found) to strengthen workflow clarity.

Dimension	Reasoning	Score
Conciseness	The body is mostly actionable but includes unnecessary padding — a marketing-style 'Why This Skill is Powerful' bullet list and a tangential Python/TypeScript SDK integration section that largely covers concepts Claude already knows — so it could be tightened.	2 / 3
Actionability	It provides concrete, copy-paste-ready commands (`scripts/search "query" 10`), explicit script-path resolution, a numbered API key setup flow, jq processing examples, and a defined output schema.	3 / 3
Workflow Clarity	The API key setup flow is sequenced with a numbered list and retry step, but general workflows lack explicit validation checkpoints and the script-path resolution guidance is somewhat implicit rather than gated.	2 / 3
Progressive Disclosure	With no bundle files present, the single SKILL.md is well-organized into clearly headed sections (setup, use cases, output, errors, architecture), satisfying progressive disclosure for a self-contained skill.	3 / 3
	Total	10 / 12 Passed

Description

72%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific and distinctive, with strong natural trigger terms for an arXiv search skill. Its main weakness is the missing explicit 'Use when...' guidance, leaving the invocation trigger implied rather than stated.

Suggestions

Add an explicit 'Use when...' clause (e.g., 'Use when searching arXiv for physics, math, or CS preprints') to fully answer the 'when' and raise completeness.

Optionally broaden the action verbs beyond a single 'search' action to list concrete operations like retrieving full-text, images, or relevance-ranked results.

Dimension	Reasoning	Score
Specificity	Names the arXiv domain and the concrete action of searching preprints via natural language queries, but only describes a single search action rather than multiple distinct concrete actions, so it is not fully comprehensive.	2 / 3
Completeness	It clearly states what the skill does, but there is no explicit 'Use when...' trigger clause, so the 'when' guidance is only implied and completeness is capped at 2 per the rubric guideline.	2 / 3
Trigger Term Quality	Uses natural terms a user would actually say — 'arXiv', 'preprints', 'physics', 'math', 'computer science', 'natural language queries' — giving good coverage of likely trigger phrasings.	3 / 3
Distinctiveness Conflict Risk	The arXiv preprint search niche is specific and clearly distinguishable, with triggers unlikely to fire for unrelated skills.	3 / 3
	Total	10 / 12 Passed

Validation

87%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

Criteria	Description	Result
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning
referenced_paths_exist	Referenced path issues: 11 missing	Warning

	Total	14 / 16 Passed

Repository: wu-yc/LabClaw
Path: skills/literature/arxiv-search/SKILL.md
Commit: df37802

Reviewed: about 1 hour ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.