CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

mlava/scholar-sidekick-mcp

Use the connected scholar-sidekick-mcp MCP server when the user mentions a scholarly identifier (DOI including shortDOI aliases, PMID, PMCID, ISBN, arXiv, ISSN, NASA ADS bibcode, WHO IRIS URL) and wants structured metadata, a formatted citation, a bibliography export file, a retraction check, an open-access check, verification that a claimed citation is real (not fabricated), or a whole-bibliography audit (batch fabrication + retraction check). Requires the MCP server connected — it works anonymously, no API key required; for a zero-install path use the scholar-sidekick-api skill instead.

72

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, information-dense body: it tells the agent exactly which tool to call, with which parameters, in what order, and how to interpret every verdict, with an explicit availability check up front and a firm never-fabricate guardrail. The main weaknesses are trimmable repetition of the same constraints across three sections and no explicit recovery loop for ambiguous or errored outcomes, plus reference-shaped detail (style lists, parameter semantics) inlined in an already long single file.

Suggestions

State the 'one identifier per call' rule for checkRetraction/checkOpenAccess exactly once (in Step 1's tool list) and the 'whole list → auditBibliography' routing exactly once, removing the duplicate restatements in the Step 1 sweep paragraph and Step 3.

Add a short recovery step for `ambiguous` and `status: "error"` verdicts (e.g., re-check the entry with `semanticTitle` off, or ask the user to confirm the intended source) so the workflow has a feedback loop rather than stop-only failure handling.

Move the CSL style enumeration and the detailed `verifyCitation`/`semanticTitle` parameter semantics into a one-level-deep reference file (e.g. references/parameters.md), keeping SKILL.md to tool selection and workflow.

DimensionReasoningScore

Conciseness

The body is dense with skill-specific operational knowledge (tool selection, parameter shapes, batching semantics) and explains nothing Claude already knows — no general PDF/library-style padding. However, key facts are repeated well beyond emphasis: the single-identifier constraint on checkRetraction/checkOpenAccess appears three times ('Single identifier per call', 'these tools accept exactly one `id` per call', 'take one identifier per call'), the 'use auditBibliography for a whole list' advice appears three times (Step 1 bullet, Step 1 sweep paragraph, Step 3), and 'do not run the tool names in a terminal' appears twice in Step 0. This fits the score-4 anchor ('Efficient; minor instances of over-explanation that could be trimmed') rather than 5, since consolidating those repetitions would trim noticeable length without losing any guidance.

4 / 5

Actionability

The guidance is fully executable for an instruction-only skill: exact tool names with per-tool selection criteria, exact parameter names and shapes (`text` vs `id`, `title` plus one identifier plus optional `author`/`year`/`container`, `semanticTitle: true`), complete enumerations of style ('vancouver, ama, apa, ieee, cse' plus CSL style IDs with a URL) and export formats, and a worked chaining example ('resolve these three IDs, format each in AMA, then export the set as BibTeX'). Per the rubric's code-vs-instruction note, absence of code is not penalized when guidance is this actionable; it covers the common cases copy-paste-ready, matching the score-5 anchor.

5 / 5

Workflow Clarity

Steps 0–5 are clearly sequenced with an explicit upfront validation checkpoint (Step 0: confirm the MCP tools are in the toolset; 'If these tools are not in your available toolset... say so plainly and stop'), and outcomes are handled explicitly — verdict semantics for matched/mismatch/ambiguous/not_found and per-entry batch error handling ('One failing entry becomes `status: "error"` without failing the batch'), so the batch-operation cap at 3 does not apply since validation and error-surfacing steps are present. It falls short of the score-5 anchor because there is no feedback/recovery loop after a checkpoint: e.g., what to do when a verdict comes back `ambiguous` (only 'moves a flagged matched to ambiguous for review' is implied), and the failure protocol is stop-only with no retry guidance — matching score 4 ('most checkpoints present; minor validation gaps').

4 / 5

Progressive Disclosure

No bundle files exist (references/, scripts/, assets/ are all absent), so the skill is a single ~87-line file. Section organization is good — 'When to Use This Skill', numbered 'How to Use' steps, 'Guidelines', 'When NOT to Use' — with clear headers and navigation. It does not reach 5 because the skill exceeds the simple-skill threshold (under 50 lines) and inlines moderately reference-shaped material that could sit in a one-level-deep reference file, e.g. the CSL style list and the detailed `verifyCitation`/`semanticTitle` parameter semantics in Step 3–4. This fits the score-4 anchor ('Good structure; most content is appropriately placed; minor organization gaps') rather than 5's clear split across well-signaled reference files.

4 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is an exemplary skill description: it names a comprehensive set of concrete capabilities, pairs them with an explicit and natural trigger clause covering all the identifier types and user intents, stays in the appropriate voice, and preempts confusion with a sibling skill and a no-key prerequisite note. Every clause carries information; there is no padding despite the length.

DimensionReasoningScore

Specificity

The description lists seven concrete actions — 'structured metadata, a formatted citation, a bibliography export file, a retraction check, an open-access check, verification that a claimed citation is real (not fabricated), or a whole-bibliography audit' — alongside a concrete identifier list (DOI, PMID, PMCID, ISBN, arXiv, ISSN, NASA ADS bibcode, WHO IRIS URL). This is comprehensive coverage matching the score-5 anchor ('Lists multiple specific concrete actions; comprehensive coverage'), and it does not fall to 4 since there are no minor gaps in the action inventory. It uses imperative voice ('Use the connected... server when...'), not first or second person, so no voice penalty applies.

5 / 5

Completeness

It explicitly answers both questions: the 'what' is the enumerated capability set (metadata, formatting, export, retraction/OA checks, fabrication verification, batch audit) and the 'when' is an explicit trigger clause — 'when the user mentions a scholarly identifier... and wants structured metadata...'. It also adds prerequisite and fallback guidance ('Requires the MCP server connected — it works anonymously, no API key required; for a zero-install path use the scholar-sidekick-api skill instead'), which strengthens rather than pads the trigger guidance. This matches the score-5 anchor; the 'when' clause is explicit with concrete trigger phrases, so the cap of 3 for a missing 'Use when...' clause does not apply.

5 / 5

Trigger Term Quality

Natural terms a user would actually say are comprehensively covered: 'DOI including shortDOI aliases, PMID, PMCID, ISBN, arXiv, ISSN, NASA ADS bibcode, WHO IRIS URL', 'retraction', 'open-access', 'citation', 'bibliography', 'real (not fabricated)'. Synonyms and variants are included (shortDOI, PMCID vs PMID, 'whole-bibliography audit'), matching the score-5 anchor for comprehensive natural-term coverage; nothing common is missing.

5 / 5

Distinctiveness Conflict Risk

It occupies a clear niche — resolving already-known scholarly identifiers into verified citations — with distinct triggers unlikely to fire for the wrong skill, and it even disambiguates against its closest sibling ('for a zero-install path use the scholar-sidekick-api skill instead'). Matching the score-5 anchor ('Clear niche with distinct triggers; minimal conflict risk'), it is not a 4 because the identifier-based triggers leave no meaningful overlap with general citation or search skills.

5 / 5

Total

20

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

13

/

16

Passed

Reviewed

On this page