CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

experiment-audit

Audit experiment integrity before claiming results. Uses cross-model review (external reviewer backend) to check for fake ground truth, score normalization fraud, phantom results, and insufficient scope. Use when user says "审计实验", "check experiment integrity", "audit results", "实验诚实度", or after experiments complete before writing claims.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Highly actionable content with a complete reviewer prompt, exact tool contracts, and concrete report templates, organized into a clear four-step workflow with validation gates. The main weaknesses are redundancy (duplicated calling-convention blocks) and dense, confusing meta-blockquotes that could be trimmed without losing function.

Suggestions

State the manual-review calling convention once (in the Reviewer Calling Convention section) and have Step 2 reference it, removing the near-verbatim duplicate config blocks.

Move the 'Reviewer-Model: <exact-model-id>' manual-response requirement out of Step 1 (artifact collection) into the manual backend branch where it belongs, and simplify the opening Selectable Reviewers blockquote to drop undefined concepts like 'slot's tier' and 'source/image inputs'.

Trim the Integration with Other Skills section to what this skill produces (EXPERIMENT_AUDIT.json and integrity_status) and drop the pseudocode describing /result-to-claim and /paper-write internal logic, which belongs in those skills.

DimensionReasoningScore

Conciseness

The body is mostly efficient (exact reviewer prompt, report templates, checklist), but includes unnecessary material: the manual-review calling convention and config block appear twice nearly verbatim (Reviewer Calling Convention section and Step 2), the opening meta-blockquotes reference undefined concepts ('this slot's tier', 'source/image inputs and deterministic gates'), and the Integration section documents other skills' (/result-to-claim, /paper-write) internal behavior. Fits anchor 3 ('could be tightened') rather than 2, since no section is pure padding.

3 / 5

Actionability

Fully executable guidance: a complete copy-paste-ready reviewer prompt with placeholder slots, exact tool names and configs (mcp__codex__codex with 'model_reasoning_effort': 'ultra', sandbox read-only), the full manual-review config, and complete EXPERIMENT_AUDIT.md/.json templates plus a printed-summary format. Matches anchor 5.

5 / 5

Workflow Clarity

Four clearly sequenced, role-labeled steps (Collect Artifacts → Send to Reviewer → Parse/Write Report → Print Summary) with validation gates (REVIEW_UNAVAILABLE on missing/same-family reviewer identity, stop-and-print-install-command when the manual MCP is unavailable) and PASS/WARN/FAIL verdict branching. Not 5 because the reviewer-identity requirement blockquote is misplaced inside Step 1 (artifact collection) and the dense header routing note muddies the workflow entry point.

4 / 5

Progressive Disclosure

The body is well-sectioned with clearly signaled one-level-deep references (shared-references/reviewer-routing.md, review-tracing.md, integration-contract.md, external-cadence.md), and inlining the ~70-line audit prompt is justified since it must be passed verbatim. No bundle files exist (references/, scripts/, assets/ absent) and everything lives in one ~320-line file, so it does not reach anchor 5's clean overview-plus-split structure; minor organization gaps keep it at 4.

4 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capability list, explicit bilingual trigger phrases and a post-experiment timing condition, distinct niche, and correct third-person voice. Only gap is a few natural English trigger variations.

DimensionReasoningScore

Specificity

The description lists multiple specific concrete actions — 'check for fake ground truth, score normalization fraud, phantom results, and insufficient scope' — plus the mechanism ('Uses cross-model review (external reviewer backend)'), giving comprehensive coverage of the skill's checks. It is not 4 because there are no minor gaps in the enumerated capabilities.

5 / 5

Completeness

It explicitly answers both what ('Audit experiment integrity... to check for fake ground truth, score normalization fraud, phantom results, and insufficient scope') and when ('Use when user says... or after experiments complete before writing claims') with concrete trigger phrases, matching the anchor-5 example exactly. Third person voice is used throughout.

5 / 5

Trigger Term Quality

Natural trigger phrases are present in two languages ('audit results', 'check experiment integrity', '审计实验', '实验诚实度') plus a temporal trigger ('after experiments complete before writing claims'), but common English variations such as 'validate results' or 'verify results' are missing. Good keyword coverage with a few natural terms absent fits anchor 4 rather than 5's comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

A clear niche — experiment integrity fraud auditing via cross-model review — with distinct, domain-specific triggers ('fake ground truth', 'score normalization fraud', 'phantom results') unlikely to fire for other skills. Minimal conflict risk.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 2 suspicious

Warning

Total

13

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/experiment-audit/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.