Content
82%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A strong, information-dense body: it tells the agent exactly which tool to call, with which parameters, in what order, and how to interpret every verdict, with an explicit availability check up front and a firm never-fabricate guardrail. The main weaknesses are trimmable repetition of the same constraints across three sections and no explicit recovery loop for ambiguous or errored outcomes, plus reference-shaped detail (style lists, parameter semantics) inlined in an already long single file.
Suggestions
State the 'one identifier per call' rule for checkRetraction/checkOpenAccess exactly once (in Step 1's tool list) and the 'whole list → auditBibliography' routing exactly once, removing the duplicate restatements in the Step 1 sweep paragraph and Step 3.
Add a short recovery step for `ambiguous` and `status: "error"` verdicts (e.g., re-check the entry with `semanticTitle` off, or ask the user to confirm the intended source) so the workflow has a feedback loop rather than stop-only failure handling.
Move the CSL style enumeration and the detailed `verifyCitation`/`semanticTitle` parameter semantics into a one-level-deep reference file (e.g. references/parameters.md), keeping SKILL.md to tool selection and workflow.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense with skill-specific operational knowledge (tool selection, parameter shapes, batching semantics) and explains nothing Claude already knows — no general PDF/library-style padding. However, key facts are repeated well beyond emphasis: the single-identifier constraint on checkRetraction/checkOpenAccess appears three times ('Single identifier per call', 'these tools accept exactly one `id` per call', 'take one identifier per call'), the 'use auditBibliography for a whole list' advice appears three times (Step 1 bullet, Step 1 sweep paragraph, Step 3), and 'do not run the tool names in a terminal' appears twice in Step 0. This fits the score-4 anchor ('Efficient; minor instances of over-explanation that could be trimmed') rather than 5, since consolidating those repetitions would trim noticeable length without losing any guidance. | 4 / 5 |
Actionability | The guidance is fully executable for an instruction-only skill: exact tool names with per-tool selection criteria, exact parameter names and shapes (`text` vs `id`, `title` plus one identifier plus optional `author`/`year`/`container`, `semanticTitle: true`), complete enumerations of style ('vancouver, ama, apa, ieee, cse' plus CSL style IDs with a URL) and export formats, and a worked chaining example ('resolve these three IDs, format each in AMA, then export the set as BibTeX'). Per the rubric's code-vs-instruction note, absence of code is not penalized when guidance is this actionable; it covers the common cases copy-paste-ready, matching the score-5 anchor. | 5 / 5 |
Workflow Clarity | Steps 0–5 are clearly sequenced with an explicit upfront validation checkpoint (Step 0: confirm the MCP tools are in the toolset; 'If these tools are not in your available toolset... say so plainly and stop'), and outcomes are handled explicitly — verdict semantics for matched/mismatch/ambiguous/not_found and per-entry batch error handling ('One failing entry becomes `status: "error"` without failing the batch'), so the batch-operation cap at 3 does not apply since validation and error-surfacing steps are present. It falls short of the score-5 anchor because there is no feedback/recovery loop after a checkpoint: e.g., what to do when a verdict comes back `ambiguous` (only 'moves a flagged matched to ambiguous for review' is implied), and the failure protocol is stop-only with no retry guidance — matching score 4 ('most checkpoints present; minor validation gaps'). | 4 / 5 |
Progressive Disclosure | No bundle files exist (references/, scripts/, assets/ are all absent), so the skill is a single ~87-line file. Section organization is good — 'When to Use This Skill', numbered 'How to Use' steps, 'Guidelines', 'When NOT to Use' — with clear headers and navigation. It does not reach 5 because the skill exceeds the simple-skill threshold (under 50 lines) and inlines moderately reference-shaped material that could sit in a one-level-deep reference file, e.g. the CSL style list and the detailed `verifyCitation`/`semanticTitle` parameter semantics in Step 3–4. This fits the score-4 anchor ('Good structure; most content is appropriately placed; minor organization gaps') rather than 5's clear split across well-signaled reference files. | 4 / 5 |
Total | 17 / 20 Passed |