setup-arxiv-mcp

Guide for setup arXiv paper search MCP server using Docker MCP

Quality

45%

Does it follow best practices?

Impact

—

No eval scenarios have been run

Securityby

Advisory

Suggest reviewing before use

Fix and improve this skill with Tessl

tessl review fix ./plugins/mcp/skills/setup-arxiv-mcp/SKILL.md

Quality

Content

50%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This skill provides a functional guide for setting up the paper-search MCP server with a clear step sequence and concrete tool invocations. Its main weaknesses are verbosity (especially the inline CLAUDE.md template and source listings), lack of error handling/validation checkpoints after critical steps, and the monolithic structure that could benefit from splitting the CLAUDE.md template into a separate file.

Suggestions

Add explicit error handling after step 3 (mcp-add) and step 4 (test)—what should Claude do if the server fails to activate or the test query returns an error?

Move the CLAUDE.md template content to a separate bundle file (e.g., CLAUDE_TEMPLATE.md) and reference it from the skill to reduce inline verbosity.

Remove the enumeration of all academic sources (arXiv, PubMed, bioRxiv, etc.) from step 3—this information is already in the CLAUDE.md template and is redundant.

Clarify the mcp-find/mcp-add/mcp-exec syntax—are these MCP tool calls? Specify the exact tool names and parameter format Claude should use.

Dimension	Reasoning	Score
Conciseness	The skill includes some unnecessary content like listing all academic sources the paper-search server provides, and the CLAUDE.md template is quite verbose. The step-by-step structure is reasonable but could be tightened—Claude doesn't need explanations of what arXiv or PubMed are.	2 / 3
Actionability	The skill provides concrete tool invocations (mcp-find, mcp-add, mcp-exec) with specific arguments, which is good. However, these are pseudo-commands rather than truly executable code—the syntax (e.g., `mcp-find query: "paper-search"`) is tool-specific and not standard shell commands. The Docker installation step is vague ('guide user to connect MCP').	2 / 3
Workflow Clarity	The steps are clearly sequenced (1-6) with a logical flow from setup context through testing. However, there's no explicit validation/error handling after adding the server (step 3), and the test in step 4 lacks guidance on what to do if it fails. The feedback loop for Docker installation (step 2) is decent but the overall workflow lacks checkpoints.	2 / 3
Progressive Disclosure	The content is reasonably structured with numbered sections, but it's monolithic—the lengthy CLAUDE.md template content is inline rather than in a separate file. There are no bundle files or external references to support progressive disclosure. The alternative section (step 6) is a nice touch but adds length to an already long single file.	2 / 3
	Total	8 / 12 Passed

Description

40%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description identifies a specific niche (arXiv paper search MCP server setup via Docker) which gives it good distinctiveness, but it reads more like a title than a proper description. It lacks a 'Use when...' clause, does not list concrete actions beyond 'setup', and could benefit from more natural trigger terms related to academic research and MCP configuration.

Suggestions

Add an explicit 'Use when...' clause, e.g., 'Use when the user wants to set up or configure an arXiv paper search tool, install an MCP server for academic research, or troubleshoot Docker MCP integration.'

List specific concrete actions the skill covers, such as 'Configures Docker containers, sets up MCP server endpoints, connects arXiv search API, and troubleshoots connection issues.'

Include natural trigger term variations like 'academic papers', 'research papers', 'arxiv API', 'MCP tool setup', 'Docker configuration' to improve matching.

Dimension	Reasoning	Score
Specificity	Names the domain (arXiv paper search MCP server) and a general action (setup using Docker MCP), but does not list multiple concrete actions or capabilities beyond setup guidance.	2 / 3
Completeness	Provides a weak 'what' (guide for setup) but completely lacks a 'when should Claude use it' clause. The absence of explicit trigger guidance caps this at a low score.	1 / 3
Trigger Term Quality	Includes relevant keywords like 'arXiv', 'paper search', 'MCP server', and 'Docker MCP' which users might mention, but misses common variations like 'academic papers', 'research papers', 'arxiv search', or 'MCP configuration'.	2 / 3
Distinctiveness Conflict Risk	The combination of 'arXiv paper search' and 'Docker MCP' is quite specific and niche, making it unlikely to conflict with other skills.	3 / 3
	Total	8 / 12 Passed

Validation

90%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 10 / 11 Passed

Validation for skill structure

Criteria	Description	Result
frontmatter_unknown_keys	Unknown frontmatter key(s) found; consider removing or moving to metadata	Warning

	Total	10 / 11 Passed

Repository: NeoLabHQ/context-engineering-kit
Commit: 3711edf

Reviewed: 20 days ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.