CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

agent-eval

カスタムタスクでコーディングエージェント(Claude Code、Aider、Codex など)をヘッドツーヘッドで比較し、合格率、コスト、時間、一貫性のメトリクスを測定します

Quality

75%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./docs/ja-JP/skills/agent-eval/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an efficient, highly actionable guide with executable YAML and CLI examples and a clear three-step workflow. Its only weaknesses are minor: an empty install section, no failure-recovery guidance, and all detail kept inline. It is a strong skill content document overall.

DimensionReasoningScore

Conciseness

The body is lean: a compact metrics table, a complete YAML template, and direct CLI commands, with almost no explanation of concepts Claude already knows. Minor trimming opportunities (the motivational intro line 「感覚に頼りがちです—体系化します」 and the nearly empty インストール section) keep it below 5; it is well above 3 because there is no real padding or over-explanation.

4 / 5

Actionability

Executable, copy-paste-ready guidance dominates: a complete task YAML example, concrete commands (agent-eval run --task ... --runs 3, agent-eval report --format table), and per-judge-type YAML snippets. Minor gaps — the インストール section gives no actual install command and the workflow uses a placeholder comment for task creation — keep it below 5; it is above 3 because all examples are executable rather than pseudocode.

4 / 5

Workflow Clarity

The three-step workflow (タスク定義 → エージェント実行 → 結果比較) is clearly sequenced with concrete commands, and judge execution provides pass/fail validation with git worktree isolation protecting the base repo. Below 5 because there is no explicit error-recovery guidance (e.g., what to do when a run or judge fails); above 3 because the sequence is explicit and validation is built in via judges.

4 / 5

Progressive Disclosure

Sections are well-organized (コンセプト / ワークフロー / ジャッジタイプ / ベストプラクティス) with the external repo link clearly signaled and no bundle files to mis-manage. Below 5 because at ~135 lines everything is inline — judge-type details or example task definitions could live in a separate reference file; above 3 because the structure is clear and nothing is buried.

4 / 5

Total

16

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific and distinctive, clearly conveying what the tool does and which agents and metrics it covers. Its main weakness is the complete absence of 'when to use' trigger guidance, which caps completeness. Adding a 'Use when...' clause with natural synonyms would materially improve it.

Suggestions

Add an explicit trigger clause, e.g. 'Use when comparing or benchmarking coding agents (Claude Code, Aider, Codex など), evaluating agent performance before adoption, or regression-checking agents after model/tool updates.'

Include natural synonyms such as ベンチマーク / 評価 / benchmark / evaluate to broaden trigger-term coverage.

Mention the comparison report output (合格率・コスト・時間・一貫性の比較レポートを生成) to round out the capability coverage.

DimensionReasoningScore

Specificity

The description states concrete actions — head-to-head comparison of coding agents (Claude Code, Aider, Codex) on custom tasks — and explicitly enumerates four measured metrics (合格率、コスト、時間、一貫性). It falls short of 5 because coverage is incomplete (e.g., report generation and regression checking are not mentioned), but exceeds 3 by listing several specific actions.

4 / 5

Completeness

The 'what' is clearly answered (compares coding agents on custom tasks, measuring pass rate, cost, time, consistency), but there is no 'Use when...' clause or any equivalent explicit trigger guidance, which caps completeness at 3 per the rubric guidelines. It is not 2 because the 'what' is concrete and comprehensive, and not 4 because 'when' is entirely absent rather than merely under-specified.

3 / 5

Trigger Term Quality

Natural phrases like コーディングエージェント, ヘッドツーヘッドで比較, plus the named tools (Claude Code、Aider、Codex) give good keyword coverage. Missing common synonyms such as ベンチマーク, 評価, or 'benchmark'/'evaluate' keep it below 5; it is above 3 because the core natural terms users would say are present.

4 / 5

Distinctiveness Conflict Risk

Head-to-head agent comparison with named tools and specific metrics carves a mostly distinct benchmarking niche with only minor overlap risk against general agent-usage or testing skills. It is not 5 because there are no explicit distinct trigger phrases, and not 3 because the metric-driven comparison framing is clearly distinguishable.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

affaan-m/ECC

Path

docs/ja-JP/skills/agent-eval/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.