setup-arxiv-mcp
Guide for setup arXiv paper search MCP server using Docker MCP
52
41%
Does it follow best practices?
Impact
Pending
No eval scenarios have been run
Advisory
Suggest reviewing before use
Optimize this skill with Tessl
npx tessl skill review --optimize ./plugins/mcp/skills/setup-arxiv-mcp/SKILL.mdQuality
Discovery
32%Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.
The description identifies a narrow domain (arXiv paper search MCP server setup via Docker) which gives it some distinctiveness, but it reads more like a title than a proper skill description. It lacks concrete actions, explicit trigger guidance ('Use when...'), and sufficient natural language keywords to help Claude reliably select this skill.
Suggestions
Add an explicit 'Use when...' clause, e.g., 'Use when the user wants to set up, configure, or troubleshoot an arXiv paper search MCP server using Docker.'
List specific concrete actions the skill covers, such as 'Configures Docker containers, sets up MCP server endpoints, connects arXiv search API, and troubleshoots connection issues.'
Include natural trigger terms users might say, such as 'research papers', 'academic search', 'arxiv API', 'MCP tool setup', 'Docker MCP configuration'.
| Dimension | Reasoning | Score |
|---|---|---|
Specificity | Names the domain (arXiv paper search MCP server) and a general action (setup using Docker MCP), but does not list multiple concrete actions or capabilities beyond setup guidance. | 2 / 3 |
Completeness | Describes what it does (guide for setting up arXiv paper search MCP server) but has no explicit 'Use when...' clause or equivalent trigger guidance, and the 'what' itself is weak. Per rubric, missing 'Use when' caps completeness at 2, and the weak 'what' brings it to 1. | 1 / 3 |
Trigger Term Quality | Includes relevant keywords like 'arXiv', 'paper search', 'MCP server', and 'Docker MCP' which users might mention, but misses common variations like 'academic papers', 'research papers', 'arxiv-search', or 'MCP configuration'. | 2 / 3 |
Distinctiveness Conflict Risk | The combination of 'arXiv' and 'Docker MCP' is fairly specific and unlikely to conflict with many other skills, but the description is vague enough that it could overlap with general MCP setup or Docker configuration skills. | 2 / 3 |
Total | 7 / 12 Passed |
Implementation
50%Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
This skill provides a reasonable walkthrough for setting up a paper-search MCP server via Docker MCP, with a clear sequential structure and practical workaround for the known arxiv-mcp-server issue. Its main weaknesses are the lack of explicit error handling/validation feedback loops (especially if the test in step 4 fails), somewhat vague Docker installation guidance, and the large inline CLAUDE.md template that inflates the document. The non-standard command syntax (mcp-find, mcp-add, mcp-exec) could benefit from clearer context about what these actually are.
Suggestions
Add explicit error handling after step 4's test—what should happen if mcp-exec fails? Include a feedback loop (check error, retry, or fall back to the alternative in step 6).
Add a concrete verification command in step 2 instead of the vague 'attempt to use mcp-find tool'—show the exact command and expected success/failure output.
Consider moving the CLAUDE.md template content to a separate bundle file (e.g., CLAUDE_TEMPLATE.md) and referencing it, to reduce inline bulk.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The skill is moderately efficient but includes some unnecessary content. The full list of academic sources and the extensive CLAUDE.md template with all tools listed adds bulk. The explanation about arxiv-mcp-server having EOF errors is useful context, but the detailed tool listing in the CLAUDE.md block could be more concise. | 2 / 3 |
Actionability | The skill provides specific tool invocations (mcp-find, mcp-add, mcp-exec) with concrete arguments, which is good. However, the commands use a non-standard syntax format (not clearly shell commands or API calls), and the Docker MCP installation steps are vague links rather than concrete commands. The mcp-exec test step is concrete and copy-paste ready. | 2 / 3 |
Workflow Clarity | The workflow has a clear 6-step sequence with a logical progression from setup context through testing. However, validation is limited—step 4 tests with a query but there's no explicit error handling or feedback loop if the test fails. The Docker availability check in step 2 lacks a concrete verification command, just saying 'attempt to use mcp-find tool.' | 2 / 3 |
Progressive Disclosure | The content is reasonably structured with numbered sections and clear headers. However, with no bundle files, the large CLAUDE.md template block (which is output content, not instructional content) takes up significant space inline. The alternative section (step 6) is a nice touch but the overall document is somewhat monolithic for its length. | 2 / 3 |
Total | 8 / 12 Passed |
Validation
90%Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.
Validation — 10 / 11 Passed
Validation for skill structure
| Criteria | Description | Result |
|---|---|---|
frontmatter_unknown_keys | Unknown frontmatter key(s) found; consider removing or moving to metadata | Warning |
Total | 10 / 11 Passed | |
- Repository
- NeoLabHQ/context-engineering-kit
- Commit
dedca19
- Reviewed
Table of Contents
Is this your skill?
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.