CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

novelty-check

Verify research idea novelty against recent literature. Use when user says "查新", "novelty check", "有没有人做过", "check novelty", or wants to verify a research idea is novel before implementing.

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable instruction skill with a clear phase workflow, concrete MCP integration details, and strong calibration guidance. The main cost is redundancy — the verdict-limits philosophy is stated twice and padded — and a missing error path for a failed review job.

Suggestions

Deduplicate the "two failures waste months equally" thesis and the proximity/ABANDON reasoning, which appear in both the NOVELTY VERDICT LIMITS block and Important Rules — state each idea once and cross-reference it.

Add 2-3 example search query formulations in Phase B (e.g., for a method claim: "<technique> + <task> arXiv 2025") so the "3 different query formulations" rule is copy-paste executable rather than abstract.

Add a fallback path in Phase C for when the review job errors or times out (e.g., bounded retry count, then report Phase B findings directly with a note that independent review was unavailable).

DimensionReasoningScore

Conciseness

No padding of concepts Claude already knows, but the body repeats itself: "Two failures waste months equally" and its false-positive/false-negative thesis appear in both the NOVELTY VERDICT LIMITS block and Important Rules, and the verdict limits are philosophically repetitive ("CAUTION is not a safe middle", "choose the more permissive one"). It could be tightened without losing content; not 4 because the duplication is more than minor trimming.

3 / 5

Actionability

Concrete, executable guidance throughout: named MCP tools (mcp__claude-review__review_start / review_status), the polling protocol (save jobId, bounded waitSeconds until done=true, retain threadId), 3 query formulations per claim with year filters, WebFetch of abstracts, and a full output template. Not 5: the MCP call shows a placeholder prompt rather than a copy-paste-ready example, and no sample search queries are given.

4 / 5

Workflow Clarity

A clearly sequenced Phase A→D workflow with a verification checkpoint (independent reviewer with poll-until-done) and explicit decision rules for the verdict. Not 5: there is no error-recovery path if the review job fails or times out, and no fallback if the reviewer is unreachable.

4 / 5

Progressive Disclosure

A single well-sectioned file with clear headers (Constants, Instructions, phases, Important Rules, Review Tracing) and one clearly-signaled one-level reference (../shared-references/review-tracing.md) with its output directory specified. The verdict-limits block and report template are rightly inline since they must be copied verbatim; no bundle files exist to split into. Not 5: the external reference is outside the bundle and the skill is monolithic beyond the ~50-line simple-skill case.

4 / 5

Total

15

/

20

Passed

Description

90%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit what-and-when structure, third-person voice, and comprehensive bilingual trigger terms. The only weakness is that the capability statement is a single action rather than an enumeration of what the check involves.

DimensionReasoningScore

Specificity

"Verify research idea novelty against recent literature" names the domain and one concrete action but does not list several specific actions. It is not 4 because only a single action is stated, not multiple with minor gaps.

3 / 5

Completeness

Explicitly answers both what ("Verify research idea novelty against recent literature") and when ("Use when user says… or wants to verify… before implementing") with concrete trigger phrases. Third-person voice is used throughout.

5 / 5

Trigger Term Quality

Covers natural triggers in two languages with synonyms — "查新", "novelty check", "有没有人做过", "check novelty" — plus the situational phrase "wants to verify a research idea is novel before implementing". Not below 5: no natural variation a user would plausibly say is missing for this task.

5 / 5

Distinctiveness Conflict Risk

A clear niche (literature novelty verification for research ideas) with distinct triggers unlikely to fire for other skills. "查新" and "novelty check" are unambiguous markers for this skill alone.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/skills-codex-claude-review/novelty-check/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.