CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ax-refine

Use this skill when writing or reviewing Ax bestOfN/refine code, reward functions, thresholds, native sample selection, serial attempts, generated advice, and attempt diagnostics.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

90%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A lean, highly actionable reference skill: executable examples for both APIs, a concrete reward function, and precise behavioral rules with no wasted tokens. The only gaps are the lack of an explicit ordered setup workflow and it being slightly over the size threshold where pure inline organization would merit a top progressive-disclosure score.

DimensionReasoningScore

Conciseness

77 lean, prescriptive lines with no padding of known concepts — rules like 'streamingForward(...) is unsupported; score complete outputs instead' and 'Do not add DSPy-style hint_ signature fields' earn their tokens; 'Higher is better' is a needed convention statement, not over-explanation.

5 / 5

Actionability

Two complete, copy-paste-ready TypeScript examples with real options (n, threshold, rewardFn, rounds, samplesPerRound), a concrete reward function, and exact API behaviors (getAttempts(), addStreamingAssert(fieldName, fn, message?)) covering the common cases — matching the fully-executable anchor.

5 / 5

Workflow Clarity

The opening decision rule ('Use bestOfN(...) when you can score complete outputs independently. Use refine(...) when failed rounds should produce feedback') is unambiguous and retry/feedback behavior is described, but no explicit ordered setup sequence (choose strategy, write rewardFn, add asserts) is given — clear guidance with minor sequencing gaps rather than explicit checkpoints.

4 / 5

Progressive Disclosure

No bundle files exist and the body is well-organized into seven clearly labeled sections with all content appropriately inline; at ~77 lines it exceeds the under-50-line simple-skill exception for a 5, so 'good structure; most content appropriately placed' (anchor 4) is the best fit.

4 / 5

Total

18

/

20

Passed

Description

80%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A highly specific, domain-niche description with an explicit trigger clause and a comprehensive enumerated scope. Its weaknesses are the absence of natural-language synonyms for jargon terms and an implicit rather than stated 'what does this skill do' statement.

Suggestions

Lead with a short third-person capability statement (e.g., 'Guides Ax bestOfN/refine selection, reward scoring, and retry configuration') before the 'Use when' clause so the 'what' is explicit, not implied.

Add natural trigger synonyms and variations users might say, such as 'retry loops', 'candidate sampling', 'reward scoring', or 'self-refinement', alongside the current API-jargon terms.

Ground the generic terms ('reward functions', 'thresholds', 'generated advice') to the Ax context more tightly to reduce overlap with generic LLM-optimization skills.

DimensionReasoningScore

Specificity

Enumerates seven concrete capability items — 'bestOfN/refine code, reward functions, thresholds, native sample selection, serial attempts, generated advice, and attempt diagnostics' — with comprehensive coverage and no visible gaps, matching the score-5 anchor.

5 / 5

Completeness

The 'when' is explicit and specific ('Use this skill when writing or reviewing...'), but the 'what' is only implied by the enumerated scope rather than stated as a standalone capability, which matches anchor 4 ('both present; could be more explicit') rather than anchor 5's clearly explicit both.

4 / 5

Trigger Term Quality

'bestOfN', 'refine', and 'reward functions' are natural terms an Ax user would say, but phrases like 'native sample selection' and 'attempt diagnostics' are framework jargon and no synonyms or variations (retry, sampling, scoring) are included, so it fits 'good keyword coverage; a few natural terms missing' rather than comprehensive coverage.

4 / 5

Distinctiveness Conflict Risk

'Ax bestOfN/refine' is a clear niche, but generic terms like 'reward functions', 'thresholds', and 'generated advice' could overlap with optimization or eval skills for other frameworks, fitting 'mostly distinct; minor overlap risk'.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

ax-llm/ax

Path

website/static/typescript/.well-known/agent-skills/ax-refine/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.