CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

novelty-check

Verify research idea novelty against recent literature. Use when user says "查新", "novelty check", "有没有人做过", "check novelty", or wants to verify a research idea is novel before implementing.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built instruction skill: a clear four-phase pipeline, concrete tooling and quotas, and a calibrated verdict framework that guards against both false-positive and false-negative novelty calls. Its weaknesses are modest — duplicated calibration rules, meta-overlay commentary, and missing failure-path handling in the workflow.

Suggestions

Deduplicate the calibration guidance: the 'two failures waste months equally' framing and the permissiveness rule appear in both the NOVELTY VERDICT LIMITS block and Important Rules — keep them only where the reviewer must see them and reference the block from Important Rules.

Add a short failure-path note in Phase C (reviewer job errors, timeout, or empty Phase B results) so the workflow has an explicit recovery branch rather than an implicit happy path.

Make Phase B's 'Known paper databases' step actionable by giving concrete lookup commands or URLs (e.g., arXiv listing URLs or venue accepted-paper pages) instead of venue names alone.

DimensionReasoningScore

Conciseness

The body assumes Claude's competence (no explanation of what arXiv or literature review is) and every section drives action, but there is real duplication: 'Two failures waste months equally' appears nearly verbatim in both the verdict limits block and Important Rules, and the Codex/Gemini overlay notes at the top are meta-commentary unrelated to the task. This fits 'efficient; minor instances that could be trimmed' rather than the lean 5 anchor.

4 / 5

Actionability

Guidance is mostly executable: named MCP tools with jobId polling semantics ('mcp__gemini-review__review_start', 'poll mcp__gemini-review__review_status ... until done=true'), concrete search quotas ('Try at least 3 different query formulations per claim', year filters 2024-2026), and a copy-ready report template. It stops short of 5 because Phase B's 'Known paper databases: Check against' gives venues but no URLs or lookup method, and the Phase C call is sketched as a YAML-ish prompt block rather than an actual tool invocation.

4 / 5

Workflow Clarity

Phases A-D are cleanly sequenced with inputs and outputs at each stage, and Phase C's cross-model verification plus the verbatim verdict limits act as an explicit checkpoint on Phase B's search results. It misses 5 because there are no error-recovery or edge-case branches (what to do when no papers surface, when the reviewer job fails or times out, or when claims are fewer than 3).

4 / 5

Progressive Disclosure

The body is well-organized with clear section headers (Constants, Instructions by phase, verdict limits, report template, Important Rules) and no phantom or buried references — it correctly references no bundle files, and none exist. The ~25-line verdict limits block and the report template are needed on every run, so inline placement is appropriate; minor organization gaps (e.g., Important Rules mixing calibration guidance with scope rules) keep it at 4 rather than 5.

4 / 5

Total

16

/

20

Passed

Description

90%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete, and unambiguous about both capability and trigger conditions, with unusually good multilingual trigger coverage. The only weakness is modest specificity of the stated action compared to the multi-step process the body actually delivers.

DimensionReasoningScore

Specificity

Names the domain ('research idea novelty') and one concrete action ('verify ... against recent literature'), matching the 'domain plus 1-2 concrete actions' anchor. It stays at 3 rather than 4 because it does not enumerate several specific actions (e.g., multi-source search, reviewer verification, report output) that the body actually performs, and 2 would understate the clarity of the stated action.

3 / 5

Completeness

Explicitly answers what ('Verify research idea novelty against recent literature') and when ('Use when user says ... or wants to verify a research idea is novel before implementing') with concrete trigger phrases, exactly matching the 5 anchor. Neither 4 ('when could be more explicit') nor any lower anchor applies.

5 / 5

Trigger Term Quality

Triggers cover natural phrasings a user would actually say across two languages: '查新', 'novelty check', '有没有人做过', 'check novelty', plus the intent-level trigger 'wants to verify a research idea is novel before implementing'. This matches the comprehensive synonym coverage anchor; the neighboring 4 anchor ('a few natural terms missing') does not fit since both casual and formal variants are present.

5 / 5

Distinctiveness Conflict Risk

It occupies a clear niche (pre-implementation novelty verification of research ideas) with distinct triggers including unique Chinese phrases ('查新', '有没有人做过') that no generic skill would claim, giving minimal conflict risk. It fits the 'clear niche with distinct triggers' anchor, not the 4 anchor's 'minor overlap risk with closely related skills'.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/skills-codex-gemini-review/novelty-check/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.