CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

paper-claim-audit

Zero-context verification that every number, comparison, and scope claim in the paper matches raw result files. Uses a fresh Codex reviewer with no prior context; base output is same-family provisional. Use when user says "审查论文数据", "check paper claims", "verify numbers", "论文数字核对", or before submission to ensure paper-to-evidence fidelity.

Quality

69%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/skills-codex/paper-claim-audit/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

45%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The core audit workflow is well designed — a clear four-step sequence, a concrete reviewer protocol with named failure modes, and a thorough verdict table — but the execution is buried under repeated internal assurance policy and depends on external contracts that are not shipped in the bundle. The skill reads as a page torn from a larger pipeline manual rather than a self-contained, followable instruction file.

Suggestions

Consolidate the fresh-reviewer / same-family-provisional rules, currently repeated across the opening blockquotes, Step 2, Key Rules, and the Thread independence section, into a single short section; this would cut substantial duplication.

Move the full spawn_agent message template and the PAPER_CLAIM_AUDIT.json schema into reference files (e.g., references/audit-protocol.md, references/artifact-schema.json) and link to them one level deep, keeping SKILL.md as an overview.

Ship the referenced shared-references contracts inline or as actual bundle files — the five cited `shared-references/*.md` files plus `reviewer_route.py`, `save_trace.sh`, and `verify_paper_audits.sh` do not exist in the bundle, so the routing, tracing, and verification instructions cannot be followed as written.

DimensionReasoningScore

Conciseness

The body is noticeably padded: the fresh-reviewer rule is stated at least four times (opening blockquotes, "CRITICAL: Use a fresh reviewer agent every run", Key Rules "Fresh thread EVERY run", and the Thread independence section), and large sections ("Review Tracing", "Submission Artifact Emission", reviewer-routing blockquotes) repeat internal assurance policy in dense prose. This matches anchor 2 ("several unnecessary explanations or padded sections") better than anchor 3, since a zero-context reader cannot resolve much of this material and the redundancy is systematic rather than occasional.

2 / 5

Actionability

There is real concrete guidance — the embedded audit protocol with seven named failure modes, the per-claim output format, report templates, and a verdict decision table. But the central action (spawning the reviewer) is given only as a pseudo-YAML `spawn_agent:` block rather than an executable command, key values are placeholders ("[list .tex file paths]"), and the routing/tracing mechanics are delegated to files that do not exist in the bundle (`reviewer_route.py`, `save_trace.sh`, `shared-references/*.md`), leaving gaps beyond anchor 4's "minor gaps".

3 / 5

Workflow Clarity

Steps 1–4 (collect files → fresh reviewer audit → write report → print summary) are clearly sequenced, and checkpoints are mostly present: a status taxonomy (exact_match … unsupported_claim), a verdict decision table covering error paths (BLOCKED, ERROR), and explicit path/hash conventions. Not a 5 because validation of the skill's own outputs is delegated to an external `verify_paper_audits.sh` that isn't shipped, and the routing blockquotes at the top obscure the entry point.

4 / 5

Progressive Disclosure

The bundle contains no reference or script files, yet the body points to at least five external docs (`../shared-references/reviewer-backends.md`, `review-tracing.md`, `integration-contract.md`, `assurance-contract.md`, `reviewer-independence.md`) and several scripts/skills — none resolvable. Meanwhile ~100 lines of template content (the full spawn_agent message and the JSON artifact schema) is inlined in SKILL.md where it belongs in separate reference files. This matches anchor 2 ("content that clearly belongs in separate files is inlined; or references are buried"); it is above anchor 3's example only in that references are at least explicitly named.

2 / 5

Total

11

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states the concrete capability, uses third person, and provides explicit multilingual trigger phrases plus a 'before submission' timing cue. The only weakness is a phrase of internal pipeline jargon ("base output is same-family provisional") that adds opacity without user value.

DimensionReasoningScore

Specificity

The description names a concrete action — "verification that every number, comparison, and scope claim in the paper matches raw result files" — with enumerated claim types and the mechanism ("Uses a fresh Codex reviewer with no prior context"). It falls just below anchor 5 because "base output is same-family provisional" is internal pipeline jargon rather than a user-facing capability, and there are minor coverage gaps (no mention of the report/artifact outputs).

4 / 5

Completeness

Explicitly answers both questions: what ("Zero-context verification that every number, comparison, and scope claim in the paper matches raw result files") and when ("Use when user says ... or before submission"), matching the anchor-5 pattern of concrete trigger phrases. Voice is third person ("Uses"), so no voice penalty applies.

5 / 5

Trigger Term Quality

Includes natural trigger phrases "check paper claims", "verify numbers", "before submission", plus Chinese variants "审查论文数据" and "论文数字核对". Not a 5: common synonyms like "audit the paper", "fact-check", or file extensions (.tex, results files) are missing, and "verify numbers" alone is somewhat generic.

4 / 5

Distinctiveness Conflict Risk

Triggers are paper-specific and unlikely to fire for unrelated skills, and the paper-framing distinguishes it from experiment/data audits. Not a 5 because "verify numbers" could overlap with closely related audit skills (the body itself lists siblings like /experiment-audit and /result-to-claim), so minor overlap risk remains.

4 / 5

Total

17

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 1 suspicious

Warning

Total

13

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/skills-codex/paper-claim-audit/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.