CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ax-agent-optimize

This skill helps an LLM generate correct AxAgent tuning and evaluation code using @ax-llm/ax. Use when the user asks about agent.optimize(...), judgeOptions, eval datasets, optimization targets, saved optimizedProgram artifacts, or agent optimization guidance.

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./website/static/typescript/.well-known/agent-skills/ax-agent-optimize/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers highly actionable, complete code patterns and clear decision rules for a complex domain, with good error-recovery guidance. Its weaknesses are repetition of the same rules across sections and a monolithic single-file structure where eval semantics and delegation details belong in reference files.

Suggestions

Consolidate the repeated rules (custom metric overrides the built-in judge; prefer a plain typed AxGen evaluator outside agent.optimize) into a single 'Metric vs Judge' section and reference it from the other sections instead of restating it.

Move the Eval Semantics MCP/UCP details and Delegation Optimization Notes into separate reference files (e.g., eval-semantics.md, delegation.md) linked from short summary bullets, so SKILL.md stays a navigable overview.

Fix the inconsistent judgeOptions.model placeholder in the canonical pattern ('judge-model' string vs the AxAIGoogleGeminiModel.Gemini35Flash enum used elsewhere) so every snippet is uniformly copy-paste ready.

DimensionReasoningScore

Conciseness

The body avoids generic padding and is dense with library-specific rules Claude would not know, but key guidance is repeated across sections: 'a custom metric overrides the built-in judge path' appears in three sections and the 'prefer a plain typed AxGen evaluator' rule is restated four times. This matches 'mostly efficient but includes some unnecessary explanation or could be tightened'; not 2 because the redundancy is duplicated rules, not explanation of known concepts.

3 / 5

Actionability

Five complete, executable TypeScript patterns (canonical with imports and save/load, minimal, deterministic metric, built-in judge, plain AxGen judge) that are copy-paste ready and cover the common cases, including task record shape and expectedActions. The only blemish is the 'judge-model' string placeholder in one snippet, which is too minor to drop it from the fully-executable anchor.

5 / 5

Workflow Clarity

A clear decision flow (goal -> target -> task design -> metric-vs-judge -> optimize -> save/load -> replay) with an explicit prerequisite ("Use agent.optimize(...) only after the agent is already configured and runnable") and a diagnostic feedback loop ("If one training task keeps collapsing to zero, inspect that task first instead of adding more optimizer rounds"). Not 5 because the sequence is distributed across thematic sections rather than one ordered workflow with explicit validation checkpoints; no destructive/batch operations apply a cap.

4 / 5

Progressive Disclosure

No bundle files exist; all ~365 lines, including self-contained topics like Eval Semantics (MCP replay details) and Delegation Optimization Notes, are inlined in one file with clear headers. Structure and navigation are good and the few external pointers (example links, sibling skills) are clearly signaled, but content that should be separate reference files is inline, matching the score-3 anchor rather than 4.

3 / 5

Total

15

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it clearly states what the skill does and when to use it, with concrete, library-specific trigger terms that keep conflict risk low. The only gap is that the capability list is narrow (tuning and evaluation code generation) relative to the full scope the body covers (artifacts, metrics, judge options, delegation).

DimensionReasoningScore

Specificity

Names the domain ("AxAgent tuning and evaluation code using @ax-llm/ax") and exactly two concrete actions ("generate correct AxAgent tuning and evaluation code"), matching the anchor for 1-2 concrete actions without comprehensive coverage. It stays at 3 because artifact save/load, metric setup, and judge configuration are absent, so 'several specific actions' (score 4) is not met.

3 / 5

Completeness

Explicitly answers both 'what' ("helps an LLM generate correct AxAgent tuning and evaluation code using @ax-llm/ax") and 'when' with a concrete trigger clause ("Use when the user asks about agent.optimize(...), judgeOptions, eval datasets..."). This is a direct match for the score-5 anchor; the 'when' is explicit with concrete trigger phrases, not weaker as the score-4 anchor requires.

5 / 5

Trigger Term Quality

Good keyword coverage with natural library-specific terms users would say: "agent.optimize(...)", "judgeOptions", "eval datasets", "optimization targets", "saved optimizedProgram artifacts". Not 5 because common synonyms like 'GEPA', 'tuning', or 'playbook' are missing, but coverage clearly exceeds the 'some relevant keywords but missing common variations' anchor.

4 / 5

Distinctiveness Conflict Risk

Clear niche with distinct library-specific triggers (agent.optimize(...), judgeOptions, optimizedProgram) and minimal conflict risk; the body even disambiguates against the sibling ax-gepa and ax-playbook skills. It would not trigger for generic agent or optimization requests.

5 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

ax-llm/ax

Path

website/static/typescript/.well-known/agent-skills/ax-agent-optimize/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.