CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

novelty-check

Verify research idea novelty against recent literature. Use when user says "查新", "novelty check", "有没有人做过", "check novelty", or wants to verify a research idea is novel before implementing.

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers an exceptionally concrete, well-sequenced novelty-verification workflow with executable MCP calls, a report template, and real validation gates. Its weaknesses are efficiency (duplicated rationale, inlined orchestration boilerplate, hard-coded years/venues that will age) and structure (heavy reliance on shared-reference files and helper scripts that are not present in this bundle).

Suggestions

State the two-failure rationale once — keep it in the verdict-limits block (which must be copied verbatim anyway) and drop the near-duplicate phrasing in Important Rules.

Move dated content (ICLR/NeurIPS/ICML year lists, 'year filters for 2024-2026', 'most recent 6 months of arXiv') into a small maintenance note or replace with relative phrasing like 'the current and previous year's major venues' so the skill does not silently go stale.

Either ship the shared-reference files and helper scripts (verify_papers.py, save_trace.sh, reviewer_route.py) inside the bundle (e.g., references/ and scripts/) or reduce the body's dependence on them — currently several instructions resolve to paths that do not exist alongside the skill.

DimensionReasoningScore

Conciseness

The body is mostly directive and dense, but includes clear tightening opportunities: the "Two failures waste months equally" rationale is stated twice (verbatim in the verdict-limits block and again in Important Rules), the reviewer-routing preamble is orchestration boilerplate peripheral to novelty checking, and time-sensitive content ("ICLR 2025/2026, NeurIPS 2025", "year filters for 2024-2026") is not isolated in a dated section. It is above the noticeably-verbose anchor because most tokens do earn their place, but below the efficient anchor.

3 / 5

Actionability

The guidance is fully executable: a copy-paste-ready MCP invocation with model and reasoning-effort config, a specified dossier file with its required contents, a verbatim block to forward to the reviewer, per-claim search tactics (3 query formulations, year filters, named venues), a complete markdown report template, and a concrete paper-verification helper with an explicit fallback policy (Policy D1). This matches the copy-paste-ready anchor covering the common cases.

5 / 5

Workflow Clarity

The process is a clearly sequenced four-phase workflow (extract claims → multi-source search → cross-model verification → structured report) with explicit validation checkpoints: abstract reading for candidate overlaps, mandatory pre-search verification of every prior-work paper via verify_papers.py, a degraded-output fallback when the helper fails, and REVIEW_UNAVAILABLE handling for the reviewer slot. The calibration limits bound the verdict step and permissive-tie guidance resolves ambiguity, matching the explicit-validation-with-feedback anchor. The workflow is read-only research, so the destructive/batch cap does not apply.

5 / 5

Progressive Disclosure

The skill is a single SKILL.md with no references/, scripts/, or assets/ bundle, yet the body leans on external files (../shared-references/reviewer-backends.md, integration-contract.md, citation-discipline.md, review-tracing.md) and helper scripts (verify_papers.py, reviewer_route.py, save_trace.sh) none of which exist in the bundle, so those links dangle; the routing preamble, citation-policy summary, and tracing policy are inlined here. References are clearly labeled with sections and are one conceptual level deep, but the unresolvable paths and inlined orchestration material keep this at the some-structure-could-be-better-organized anchor rather than the good-structure anchor.

3 / 5

Total

16

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A concise, well-formed description that clearly states what the skill does and when to use it, with natural multilingual trigger terms and a distinctive niche. Its only weakness is that the capability statement stays at the level of the single top-level action rather than naming the concrete things the skill actually does.

DimensionReasoningScore

Specificity

"Verify research idea novelty against recent literature" names the domain and the core action, but enumerates only that single action — no mention of the underlying steps (literature search, cross-model verification, structured report). This matches the anchor for domain plus 1-2 concrete actions; it is below the several-specific-actions anchor and clearly above the generic 'Processes PDF files' level.

3 / 5

Completeness

The description explicitly answers both questions: the 'what' ('Verify research idea novelty against recent literature') and the 'when' via an explicit 'Use when' clause with concrete trigger phrases. This matches the anchor that clearly and explicitly answers both with concrete triggers; it is not the level below, where the 'when' is merely present but less specific.

5 / 5

Trigger Term Quality

Triggers "查新", "novelty check", "有没有人做过", "check novelty" are natural phrases a user would actually say, with useful cross-language synonyms. Coverage is good but not comprehensive — common English variants like "has anyone done this", "prior work", or "is this novel" are missing, placing it at good-coverage-with-a-few-gaps rather than the comprehensive-synonyms anchor.

4 / 5

Distinctiveness Conflict Risk

Research-idea novelty verification is a clear niche, and triggers like "查新" and "novelty check" are distinctive phrases unlikely to fire for other skills (only mild adjacency to generic literature-review skills). It matches the clear-niche-with-distinct-triggers anchor with minimal conflict risk.

5 / 5

Total

17

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 3 suspicious

Warning

Total

13

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/novelty-check/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.