CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

write-agent-benchmarks

Build and run benchmarks that measure an AI AGENT's behaviour — scenarios, checklists, judged runs. Use when authoring or evaluating agent benchmark scenarios. Not for code performance benchmarks (deno bench, criterion) or ordinary test suites.

63

Quality

79%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./plugins/flowai-devtools/skills/write-agent-benchmarks/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers dense, actionable, framework-specific guidance with strong validation checklists and a copy-paste template, but it is held back by duplicated (and partly contradictory) mock/relay guidance between sections 6 and 6.3, a padded philosophy section, and reference hygiene issues — one dangling link and one orphaned references/ file never cited from the body.

Suggestions

Reconcile sections 6 and 6.3 into a single mock/relay-verification rule: section 6's checklist step 3 gates on the '[benchmock-<6-hex>]' sentinel token while section 6.3 says such prefix tokens fail as relay signals and only deliberately-absurd in-body phrases are robust — pick the absurd-phrase rule and update the checklist to match.

Fix reference hygiene: link 'references/PROMPTS.md' from section 4.4 (The Judge) since it contains the Judge system/user prompts, and correct or remove the dangling 'acceptance-tests/config.json' reference in section 9.

Trim section 1 'Context & Philosophy' and merge the duplicated PATH-shadow mock mechanics (section 6 'Mock mechanism (ACP)' vs section 6.3) into one place to cut token cost without losing the operational contract.

DimensionReasoningScore

Conciseness

Mostly efficient, project-specific operational content, but the mock mechanism is explained twice (section 6 'Mock mechanism (ACP): scenario.mocks is a static one-response-per-tool map' vs section 6.3 'Mocks fire on PATH resolution, not command shape') and section 1 'Context & Philosophy' is conceptual padding that could be tightened. Not 2: the bulk is non-obvious framework knowledge Claude cannot be assumed to know, not generic library explanation.

3 / 5

Actionability

Concrete and executable: a copy-paste-ready TypeScript 'Template (mod.ts)' with exact ids and checklist contracts, specific debug commands ('ls <workDir>/mockbin/ should show an executable <tool> (mode 755)'), exact directory layouts, and real example phrases. Minor gaps: step 5 'Register: Add the scenario to your Runner's registry' gives no concrete mechanism, and sections 6 vs 6.3 give contradictory relay-gating instructions. Not 5 because of those gaps.

4 / 5

Workflow Clarity

Clear sequences with explicit validation and feedback loops: the 5-step authoring workflow, the 7-step execution loop, the debug checklist gated by 'Only after steps 1–4 pass is it safe to edit SKILL.md', and RED-phase verification. Not 5: section 6's checklist step 3 calls the '[benchmock-<6-hex>]' sentinel the 'Only robust relay signal' while section 6.3 states such 'Prefix-style framing tokens ([benchmock-xxx], <TOOL>-MOCK:) fail as relay signals' — an internal contradiction that undermines which validation to follow.

4 / 5

Progressive Disclosure

Structure is sectioned and one asset link is well-signaled ('[examples/scenario-example.md](assets/scenario-example.md)' exists in the bundle), but '[acceptance-tests/config.json](acceptance-tests/config.json)' dangles — no such file exists in the bundle — and 'references/PROMPTS.md' (Judge prompt material, clearly relevant to section 4.4 'The Judge (Evaluator)') is never referenced from the body at all. Not 4: an orphaned bundle file plus a broken reference is more than a minor organization gap.

3 / 5

Total

14

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete actions, an explicit 'Use when' trigger, and an explicit negative boundary that sharply reduces mis-triggering against neighboring performance-benchmark and test-suite skills. Only minor room to grow on breadth of natural trigger synonyms.

DimensionReasoningScore

Specificity

Lists several concrete actions — 'Build and run benchmarks that measure an AI AGENT's behaviour' plus named artifacts 'scenarios, checklists, judged runs' — but coverage has minor gaps (no mention of environment setup, judging logic, or result reporting). Not 3: more than 1-2 actions are named; not 5: the action list is not comprehensive.

4 / 5

Completeness

Explicitly answers both: what ('Build and run benchmarks that measure an AI AGENT's behaviour — scenarios, checklists, judged runs') and when ('Use when authoring or evaluating agent benchmark scenarios'), with concrete trigger phrases reinforced by explicit exclusions ('Not for code performance benchmarks (deno bench, criterion) or ordinary test suites'). Matches the 5 anchor pattern directly; the 'when' clause is explicit, so 4 does not apply.

5 / 5

Trigger Term Quality

Good natural keyword coverage: 'benchmarks', 'AI AGENT's behaviour', 'scenarios', 'checklists', 'authoring or evaluating agent benchmark scenarios', plus tool names in the exclusion clause ('deno bench, criterion'). A few natural variations users might say are missing (e.g. 'evals', 'agent testing', 'agent evaluation'), so it falls short of the 5 anchor's comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

Clear niche — behavioral benchmarking of AI agents — with an explicit negative boundary that separates it from the nearest confusion candidates (code performance benchmarks, ordinary test suites). Minimal conflict risk; the exclusion clause is exactly the mechanism that distinguishes it, so 4 ('minor overlap risk') undersells it.

5 / 5

Total

18

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 1 missing

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

korchasa/flowai-plugins

Path

plugins/flowai-devtools/skills/write-agent-benchmarks/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.