CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

creating-eval-scenarios

Generate evaluation scenarios for Tessl tiles to measure skill effectiveness. Creates inventory of instructions from the skill, test cases with success criteria, and validates skill coverage. Use when asked to "generate evals", "create evaluation scenarios", "test this skill", "measure skill value", or "prepare for tessl publish".

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured skill: the body is a lean overview that delegates the detailed generation workflow to a single, real, well-signaled reference containing concrete templates, examples, and validation checklists. Remaining weaknesses are minor: the body duplicates constraint details from the reference, hides the validation step from the top-level flow, and has small typos and one naming inconsistency.

Suggestions

Trim or collapse the 'Eval Constraints' section to a single line pointing at the constraints in references/scenario-generation.md, since Quick Start already mandates reading that file first — this removes duplicated tokens.

Add a one-line checkpoint in the body between generation and 'Running Evals' (e.g. 'Verify each criteria.json sums to 100 and scenarios are sequentially numbered before running') so validation is visible at the overview level, not only inside the reference.

Fix minor typos ('Its possible' → 'It's possible', 'if its not specified' → 'if it's not specified') and reconcile scenario folder naming between the body ('scenario-N') and the reference (0-indexed 'scenario-0').

DimensionReasoningScore

Conciseness

The ~50-line body is lean with no concept explanations and assumes competence ('Mark capabilities as infeasible if they won't work in this sandbox'). It falls short of anchor 5 because the 'Eval Constraints' section duplicates sandbox/timeout constraints already detailed in the mandated reference (which the Quick Start requires reading before starting), and minor typos ('Its possible', 'if its not specified') add friction — instances that could be trimmed.

4 / 5

Actionability

Concrete output file tree with per-file requirements ('criteria.json # Scoring rubric (must sum to 100)', 'capability.txt # Single line'), copy-paste-ready commands (tessl eval run/view-status/list), and a mandated reference containing executable JSON templates and worked examples. Anchor 4's 'minor gaps' do not apply — the bundle fully specifies what to do at each step.

5 / 5

Workflow Clarity

The body sequences prerequisites (tile packaging/splitting) → generation via the reference → running evals, and the mandated reference includes an explicit validation task with checklists (criteria sum to 100, leakage checks, sequential folder numbering) matching anchor 5's feedback loops. Scored 4 because the body's own overview never surfaces a validation checkpoint before 'tessl eval run', and there is a naming inconsistency (body says 'scenario-N' while the reference specifies 0-indexed 'scenario-0').

4 / 5

Progressive Disclosure

The body is a concise overview with a single clearly-signaled, one-level-deep reference (references/scenario-generation.md, verified to exist, linked in Quick Start), with detailed workflow appropriately split out. This is a direct match for anchor 5's 'clear overview with well-signaled one-level-deep references'.

5 / 5

Total

18

/

20

Passed

Description

95%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete actions, explicit 'Use when' triggers with natural quoted phrases, and a clearly distinct niche. The only weakness is that it does not mention the eval execution/monitoring capability (tessl eval commands) that the skill body delivers.

DimensionReasoningScore

Specificity

The description lists several concrete actions ('Creates inventory of instructions from the skill, test cases with success criteria, and validates skill coverage') going beyond naming the domain. It stops short of anchor 5 because it omits the skill's running/monitoring capability ('tessl eval run/view-status') covered in the body — a minor coverage gap, not the comprehensive coverage of anchor 5.

4 / 5

Completeness

Explicitly answers both what ('Generate evaluation scenarios... Creates inventory of instructions... test cases with success criteria... validates skill coverage') and when ('Use when asked to...') with concrete trigger phrases. This is a direct match for anchor 5; anchor 4's 'when could be more explicit' does not apply given the quoted trigger list.

5 / 5

Trigger Term Quality

Five natural, directly quoted trigger phrases users would actually say: 'generate evals', 'create evaluation scenarios', 'test this skill', 'measure skill value', 'prepare for tessl publish'. These cover the main phrasings and synonyms comprehensively (file extensions are not applicable to this task type), matching anchor 5 rather than the 'a few natural terms missing' of anchor 4.

5 / 5

Distinctiveness Conflict Risk

Clear niche (evaluation scenario generation for Tessl tiles) with distinct triggers including the platform-specific 'prepare for tessl publish'. Minimal conflict risk with other skills; anchor 4's 'minor overlap risk with closely related skills' is not evidenced.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

xomyakus/spec-native-skills

Path

.tessl/tiles/tessl-labs/tessl-skill-eval-scenarios/creating-eval-scenarios/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.