Content
85%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A well-engineered skill body: an 8-step workflow with explicit risk levels, decision rules, and error-handling for network failure, backed by real scripts and well-signaled one-level-deep references. The main improvement room is in the two 4-scored dimensions: adding example CLI invocations for the scripts and trimming the platform-neutral paragraph.
Suggestions
Add copy-paste-ready command lines (with typical arguments, e.g. `python scripts/scan_ai_artifacts.py manuscript.json`) to each workflow step that names a script, lifting actionability to fully executable.
Trim or move the platform-neutral paragraph ("This skill is intentionally platform-neutral... does not require OpenAI-specific UI metadata") — it is provenance context rather than instructions for executing the skill.
Optionally condense the doubled framing around disclosure calibration in step 6, since the same pointer to references/arxiv_policy_notes.md appears twice.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is lean and skill-specific — calibration rules like "Minimise false positives at the cost of recall... a false BLOCKER is more costly than a missed LOW" earn their tokens. Minor trimmable padding remains ("This skill is intentionally platform-neutral... it does not require OpenAI-specific UI metadata"), keeping it just below the every-token-earns-its-place anchor. | 4 / 5 |
Actionability | Every workflow step names a concrete script (scripts/extract_manuscript_text.py, scripts/scan_ai_artifacts.py, scripts/verify_references.py, scripts/generate_preflight_report.py) and describes its output (manuscript.json with sections, figures, tables, cite_keys, numbers, warnings). Guidance is executable but stops short of copy-paste-ready command lines with arguments and flags, so it sits between the 4- and 5-anchors. | 4 / 5 |
Workflow Clarity | Eight clearly sequenced steps with explicit checkpoints and error recovery: "Treat unresolved or skipped includes as review risks", "If network is unavailable, mark this section INCOMPLETE rather than skipping silently", plus a Decision Rule checklist (BLOCKER→HOLD, HIGH/MEDIUM→PASS_WITH_FIXES, LOW→PASS) and never-upgrade/never-soften severity guidance. The workflow is read-only analysis, so the destructive-operation cap does not apply. | 5 / 5 |
Progressive Disclosure | The body is a concise overview with four one-level-deep reference files (arxiv_policy_notes.md, ai_artifact_patterns.md, reference_verification.md, report_template.md — all present on disk and correctly cited) plus a dedicated "When to read which reference" section mapping each file to a specific situation, which is exactly the well-signaled navigation the top anchor describes. | 5 / 5 |
Total | 18 / 20 Passed |