CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

agentpilot

Prepare and run AgentPilot improvements through one entry. Use when the user requests AgentPilot or iterative improvement with it. The current agent fills missing task/evaluation inputs, then hands a ready environment to the configured AgentPilot runner.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, guardrail-rich instruction skill: the workflow is clearly sequenced with explicit validation and failure paths, and detail is correctly pushed one level deep into a real reference file. The main costs are dense, caveat-heavy prose and a few preparation directives that stay abstract where a concrete example or command would help.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence — no space is spent explaining known concepts — but the many negative injunctions ('Do not silently build a generic environment adapter, substitute an unrelated benchmark, or claim RSI has run') could be merged and a few long clauses tightened.

4 / 5

Actionability

Concrete commands appear where needed (launcher block, 'Optional `project inspect --cwd /absolute/project`') and full executable command sets are delegated to references/formal.md, but some preparation directives remain high-level ('Reuse suitable project tests and prepare missing checks or measurements').

4 / 5

Workflow Clarity

The sequence (choose workflow → prepare inputs → hand off or report incomplete) is explicit, with validation checkpoints ('Exercise the actual evaluator on the starting program and verify that it detects a relevant failure'), a readiness checklist grounded in execution evidence, and a clear error-recovery path ('report preparation incomplete... the specific next requirement').

5 / 5

Progressive Disclosure

The 37-line overview links references/formal.md (verified to exist) with clear signaling and a read-timing condition; the reference is one level deep with complete run commands, and operational detail is appropriately split out of SKILL.md.

5 / 5

Total

18

/

20

Passed

Description

80%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with a clear what, an explicit Use-when trigger, and a distinct named-tool niche. Its one weakness is narrow trigger coverage: users who say 'RSI' or 'self-improvement loop' instead of 'AgentPilot' would not naturally match.

Suggestions

Add natural synonyms to the 'Use when' clause — e.g. 'RSI', 'self-improvement', or 'improvement run' — so requests phrased without the tool name still trigger the skill.

Include one or two artifact-level keywords users might mention (e.g. 'Arena run', 'baseline/research budget') to broaden natural-term coverage.

Make 'improvements' slightly more concrete in the what-clause (e.g. 'task, evaluation and worker setup for improvement runs') to lift specificity from several-actions to comprehensive.

DimensionReasoningScore

Specificity

Lists several concrete actions ('fills missing task/evaluation inputs', 'hands a ready environment to the configured AgentPilot runner') with minor gaps — 'improvements' itself stays abstract. Not 5 because coverage isn't comprehensive; not 3 because more than 1-2 actions are named.

4 / 5

Completeness

Clearly answers both: a multi-part 'what' ('Prepare and run AgentPilot improvements... fills missing task/evaluation inputs, then hands a ready environment') and an explicit 'Use when' clause with concrete trigger phrases. Anchor 4's caveat that 'when' could be more explicit does not apply.

5 / 5

Trigger Term Quality

'Use when the user requests AgentPilot or iterative improvement with it' provides two natural terms, but common variations the body itself relies on ('RSI', 'self-improvement', 'improvement run') are missing, so a user phrasing the request without the tool name may not trigger it.

3 / 5

Distinctiveness Conflict Risk

The named-tool niche ('AgentPilot' in both what and when) gives it distinct triggers with minimal conflict risk; 'iterative improvement with it' is bound to the tool name, keeping overlap with generic improvement skills negligible.

5 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

HKUDS/OpenSpace

Path

agentpilot/src/agentpilot/host/skills/agentpilot/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.