CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

auto-review-loop-llm

Autonomous research review loop using any OpenAI-compatible LLM API. Configure via llm-chat MCP server or environment variables. Trigger with "auto review loop llm" or "llm review".

Quality

65%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/auto-review-loop-llm/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

56%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with executable MCP/curl commands, a clear phase-gated loop, and explicit stop criteria, but pays for it in token efficiency: duplicated curl blocks, an inlined version-sensitive provider table, and editorial meta-commentary. Progressive disclosure is mediocre — everything lives in one long file with off-bundle references that cannot be verified.

Suggestions

Deduplicate the curl examples — keep one canonical curl template and have Phase A reference it instead of repeating the command.

Move the provider/model table and LLM_MAX_TOKENS_FIELD configuration detail into a references file (e.g. references/providers.md) and link to it from SKILL.md.

Delete the parenthetical changelog commentary ('Earlier wording used `or` and a stale verdict set...') and state the authoritative condition once.

Give Phase D a concrete step (e.g. how to poll experiment status and when to proceed to Phase E).

DimensionReasoningScore

Conciseness

The curl fallback is fully duplicated (the 'API Call Method' section and Phase A repeat the same commands), a version-specific provider/model table (gpt-6.1-sol, MiniMax-M3, etc.) is inlined, and it carries editorial meta-commentary ('Earlier wording used `or` and a stale verdict set...'), matching 'noticeably verbose; several unnecessary explanations or padded sections'. Not 1 because it never explains basic concepts Claude already knows.

2 / 5

Actionability

Concrete executable guidance throughout: complete MCP tool-call blocks, copy-ready curl commands with correct max_tokens vs max_completion_tokens distinctions, an exact JSON state schema, and a full markdown template for each round. Minor gaps keep it below 5: Phase B says 'extract score/verdict' without any concrete parsing step, and the prompt templates are placeholder-laden rather than a worked example.

4 / 5

Workflow Clarity

The loop is well sequenced (Initialization → Phases A-E → Termination) with an explicit STOP gate (score >= 6 AND verdict in {ready, almost}), state recovery via REVIEW_STATE.json, and failure fallbacks (Bash chunked writes, 504-timeout fallback model). Not 5 because Phase D ('Wait for Results: Monitor remote experiments') is a vague, undefined step.

4 / 5

Progressive Disclosure

No bundle files exist (no references/, scripts/, or assets/ directories), and the ../shared-references/*.md links, while clearly signaled, do not resolve from the skill's location. Content that clearly belongs in a separate reference file — the provider table, configuration details, and duplicated curl examples — is inlined in a ~280-line monolithic body, matching 'some structure but... content that should be separate is inline'. Not 4 because the bulk reference material inline is more than a minor organization gap; not 2 because section headers and links are present and clearly labeled.

3 / 5

Total

13

/

20

Passed

Description

62%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description answers both what and when with explicit, concrete trigger phrases and a clear niche, avoiding vagueness. Its weaknesses are a thin 'what' that omits the review-fix-rereview behavior and trigger terms limited to the skill's own name with no natural user synonyms.

Suggestions

State the core behavior in the 'what', e.g. 'Runs autonomous review-implement-rereview rounds on research work until an external LLM reviewer scores it ready'.

Add natural trigger variations users would actually say, such as 'review my paper', 'critique my research', or 'improve my manuscript'.

Distinguish the trigger terms from the sibling /auto-review-loop skill so the two don't compete for the same invocations.

DimensionReasoningScore

Specificity

The description names the domain ('Autonomous research review loop using any OpenAI-compatible LLM API') and one concrete action ('Configure via llm-chat MCP server or environment variables'), but stops there — the loop's actual operations (review, implement fixes, re-review) are absent. It matches the 3 anchor (domain plus 1-2 concrete actions, not comprehensive) better than 4, which expects several specific listed actions.

3 / 5

Completeness

Both what ('Autonomous research review loop using any OpenAI-compatible LLM API') and when ('Trigger with...') are present, with concrete trigger phrases satisfying the trigger-guidance requirement. Not 5 because the 'what' is thin — it never states the loop's core behavior (review, implement fixes, re-review until positive assessment) — and not 3 because the 'when' is explicit rather than weakly implied.

4 / 5

Trigger Term Quality

Two explicit trigger phrases are given ('Trigger with "auto review loop llm" or "llm review"'), but both are derived from the skill's own name; natural user phrasings like 'review my paper', 'critique my research', or 'improve my manuscript' are missing. This fits 'Some relevant keywords but missing common variations or synonyms' rather than the 4 anchor's good keyword coverage.

3 / 5

Distinctiveness Conflict Risk

The niche (LLM-driven autonomous research review with explicit name-based triggers) is clear and mostly distinct. Minor overlap risk exists with the sibling '/auto-review-loop' skill the body references, keeping it at 'mostly distinct' rather than the 5 anchor's minimal conflict risk.

4 / 5

Total

14

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 4 suspicious

Warning

Total

13

/

16

Passed

Repository

wanshuiyin/Auto-claude-code-research-in-sleep

Path

skills/auto-review-loop-llm/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.