CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

create-task

Create a new Harbor task for evaluating agents. Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval. Guides through instruction writing, environment setup, verifier design (pytest vs Reward Kit vs custom), and solution scripting.

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally actionable, well-sequenced guide: every step ships executable commands or complete config blocks, and the Oracle verification plus ordered debug checklist form a genuine validation feedback loop. Its main costs are length — the network-policy and multi-step detail could live in reference files — and unsegregated pinned versions in the pytest template.

DimensionReasoningScore

Conciseness

The body is dense and high-signal ("Don't just dump commands — walk them through each decision") with no padding about concepts Claude already knows, but time-sensitive pinned versions ("uv/0.9.7", "pytest==8.4.1") sit in the main flow rather than a segregated section, and the network-policy and multi-step deep-dives run long for a single file — efficient with minor instances that could be trimmed, matching anchor 4.

4 / 5

Actionability

Fully copy-paste-ready guidance throughout: exact scaffold and run commands ("harbor task init \"<org>/<task-name>\"", "harbor run -p \"<task-path>\" -a oracle"), complete test.sh/Dockerfile/task.toml blocks, and a worked ssh-keygen example covering the common case — matches the anchor 5 fully-executable standard.

5 / 5

Workflow Clarity

Nine clearly sequenced steps with explicit validation checkpoints and a feedback loop: "Test the environment interactively before writing the solution or tests", Oracle verification ("Reward should be 1.0"), and an ordered debug loop ("If it's not, debug in this order: 1... 2... 3... 4...") plus a real-agent difficulty check — matches anchor 5's clear sequence, explicit validation, and error-recovery loop.

5 / 5

Progressive Disclosure

Sections are well-organized and external pointers are clearly signaled ("Full reference: docs-mintlify/tasks/network-policies.mdx", "Example task: examples/tasks/hello-multi-step-advanced/"), but with no bundle files the network-policy and multi-step deep-dives are fully inlined in an already-long SKILL.md where a reference-file split would aid navigation — good structure with minor organization gaps, matching anchor 4 rather than the cleanly-split anchor 5.

4 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly answers both what the skill does and when to use it, with concrete, tool-specific actions (pytest, Reward Kit, Harbor). Its only weaknesses are a few missing natural trigger synonyms and a when-clause that isn't scoped to Harbor, leaving slight overlap risk with generic task-creation requests.

DimensionReasoningScore

Specificity

"Guides through instruction writing, environment setup, verifier design (pytest vs Reward Kit vs custom), and solution scripting" lists multiple specific concrete actions with named tooling, comprehensively covering the task-creation workflow — a clean match for the anchor 5 example style.

5 / 5

Completeness

Both parts are explicit: the what ("Create a new Harbor task for evaluating agents") and the when ("Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval") with concrete trigger phrases, exactly matching the anchor 5 pattern.

5 / 5

Trigger Term Quality

"scaffold, build, or design a new task, benchmark problem, or eval" provides good natural trigger phrasing users would actually say, but common variations like "evaluation", "test", or "challenge" are absent — good coverage with a few natural terms missing, matching anchor 4 rather than the comprehensive anchor 5.

4 / 5

Distinctiveness Conflict Risk

"Harbor task" carves a clear niche with distinct tooling, but the trigger clause "build... a new task, benchmark problem, or eval" could fire for non-Harbor task/eval-creation requests, creating minor overlap risk — mostly distinct per anchor 4, not the minimal-conflict anchor 5.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

Arize-ai/phoenix

Path

.agents/skills/create-task/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.