CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

rsi-arena

Set up or run RSI Arena benchmark evaluations from HKUDS AgentPilot. Use for AIME, Terminal-Bench, and comparing improvement methods; use agentpilot for the unified RSI entry or ordinary coding work.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An extremely lean, well-scoped overview that assumes competence and delegates detail to the external AgentPilot docs, with an explicit pre-launch verification step. The main weakness is actionability: no executable commands or verification procedures are given, so the reader must open the external READMEs for every concrete step.

Suggestions

Add the concrete commands for the most common path (e.g., how to launch an evaluation in the AgentPilot checkout and one benchmark's install command) so the core flow is executable without opening external READMEs.

Specify how to verify prerequisites (which command or check confirms task data, model configuration, and evaluator readiness) and what to do when verification fails, adding a feedback loop to the workflow.

Convert the prose paragraph into a short numbered sequence with the pre-launch verification as an explicit gate before the run step.

DimensionReasoningScore

Conciseness

Every sentence carries instruction or a functional scope guardrail ("it does not install benchmark dependencies or run paid evaluations merely by being added to a host"), with no concept explanations or padding. Lean and fully assuming of competence, matching anchor 5; anchor 4 would require something that could be trimmed, and nothing here can.

5 / 5

Actionability

Provides concrete pointers (the AgentPilot repo URL, "arena/README.md", "agentpilot/integrations/arena/README.md") but zero executable commands; "Install that component's environment" and "Use the selected formal benchmark runner" defer all execution specifics to external docs, leaving key details missing. This matches anchor 3 rather than anchor 4, which requires concrete code or commands with only minor gaps.

3 / 5

Workflow Clarity

A clear ordered sequence (obtain checkout, read docs, infer benchmark/method, install and verify, run, report) with an explicit pre-launch checkpoint ("verify its task data, model configuration, execution dependencies, and evaluator before launch") and reporting requirements. Falls short of anchor 5 because there is no error-recovery feedback loop or checklist for when verification fails; exceeds anchor 3 because the validation checkpoint is explicit, not missing or implicit.

4 / 5

Progressive Disclosure

The body is roughly 10 lines with no bundle files (references/, scripts/, assets/ are absent) and appropriately delegates all detail to clearly signaled, one-level-deep external docs (arena/README.md and agentpilot/integrations/arena/README.md). Under the simple-skill guidance this matches anchor 5: nothing is inlined that belongs elsewhere and navigation is unambiguous.

5 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capabilities, natural trigger terms, explicit what/when guidance, and explicit disambiguation against the sibling agentpilot skill. Third-person voice with no fluff or over-claims. Only minor gap is that capability coverage is not fully comprehensive.

DimensionReasoningScore

Specificity

Names concrete actions ("Set up or run RSI Arena benchmark evaluations") and specific benchmarks ("AIME, Terminal-Bench"), giving several specific elements with only minor coverage gaps. Not 5 because coverage is not comprehensive (only two core verbs), not 3 because it goes well beyond naming the domain with multiple concrete, named items.

4 / 5

Completeness

Explicitly answers both: what ("Set up or run RSI Arena benchmark evaluations from HKUDS AgentPilot") and when ("Use for AIME, Terminal-Bench, and comparing improvement methods") with concrete trigger phrases. The 'when' is explicit and specific, matching anchor 5 rather than anchor 4 where the trigger guidance would be weaker or less concrete.

5 / 5

Trigger Term Quality

Includes natural, user-sayable terms like "AIME", "Terminal-Bench", "RSI Arena", "benchmark evaluations", and "comparing improvement methods". A few natural variations are missing (e.g., other RSI Arena benchmarks or common synonyms like "evals"), so it does not reach comprehensive anchor 5 but clearly exceeds anchor 3's partial coverage.

4 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (RSI Arena benchmark evaluations from HKUDS AgentPilot) and explicitly disambiguates the closely related sibling skill ("use agentpilot for the unified RSI entry or ordinary coding work"), actively minimizing conflict risk. This matches anchor 5's clear niche with distinct triggers; anchor 4 would leave the overlap risk unaddressed.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

HKUDS/OpenSpace

Path

agentpilot/src/agentpilot/host/skills/rsi-arena/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.