CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

creating-eval-scenarios

Generate evaluation scenarios for Tessl tiles to measure skill effectiveness. Creates inventory of instructions from the skill, test cases with success criteria, and validates skill coverage. Use when asked to "generate evals", "create evaluation scenarios", "test this skill", "measure skill value", or "prepare for tessl publish".

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

72%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, lean overview that delegates the detailed generative workflow to a single one-level-deep reference and provides concrete output formats and CLI commands. The main weakness is workflow clarity: the implied sequence lacks explicit validation checkpoints for the generated eval artifacts.

Suggestions

Add an explicit validation step before running evals, e.g. 'Before running, verify every instruction in instructions.json is covered by at least one scenario and each criteria.json sums to 100' — this addresses the workflow_clarity gap.

Number the workflow steps (prerequisites -> generate -> validate -> run) so the sequence is explicit rather than implied by section order.

Trim minor padding such as 'It will guide you through the workflow of researching the tile and creating all the expected files in the correct formats' — the link and a one-line purpose suffice.

DimensionReasoningScore

Conciseness

The 55-line body is efficient with no explanations of concepts Claude already knows, but contains minor trimmable padding such as 'It will guide you through the workflow of researching the tile...' and 'Once ready, you can trigger the eval run on the tessl platform.' This matches anchor 4 rather than the every-token-earns-its-place standard of anchor 5.

4 / 5

Actionability

Concrete guidance throughout: an exact output tree with annotated filenames ('criteria.json # Scoring rubric (must sum to 100)'), sandbox constraints, and copy-paste CLI commands. The main generative workflow is delegated to the reference file, leaving minor gaps in the body itself, so it sits at anchor 4 rather than fully-executable anchor 5.

4 / 5

Workflow Clarity

The section order implies a sequence (prerequisites -> read reference guide -> produce output -> run evals), but validation checkpoints are implicit or absent — there is no step to verify instructions.json covers every instruction or that criteria sum to 100 before running. Anchor 3 ('steps listed but validation gaps') fits; it is not 4 because checkpoints are missing rather than minor.

3 / 5

Progressive Disclosure

A clear overview body with a single well-signaled, one-level-deep reference ('Read references/scenario-generation.md before starting') that exists in the bundle and contains no nested references. Content is appropriately split between overview and detailed workflow, matching the anchor-5 pattern exactly.

5 / 5

Total

16

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete deliverables, an explicit 'Use when' clause with natural quoted trigger phrases, and a clearly differentiated Tessl-specific niche. The only weaknesses are a missing mention of the eval-running capability and a few absent trigger variations.

DimensionReasoningScore

Specificity

The description lists several concrete actions ('Creates inventory of instructions from the skill, test cases with success criteria, and validates skill coverage') with specific deliverables. It falls short of anchor 5 only because the skill also triggers and monitors eval runs, which the description omits.

4 / 5

Completeness

It explicitly answers both what ('Generate evaluation scenarios for Tessl tiles... Creates inventory of instructions, test cases with success criteria, and validates skill coverage') and when ('Use when asked to...') with concrete trigger phrases, matching the anchor-5 example pattern exactly.

5 / 5

Trigger Term Quality

Includes natural quoted trigger phrases users would say: 'generate evals', 'create evaluation scenarios', 'test this skill', 'measure skill value', 'prepare for tessl publish', with synonym coverage (evals / evaluation scenarios). A few natural variations like 'run the evals' or 'evaluate this skill' are missing, so it does not reach comprehensive anchor-5 coverage.

4 / 5

Distinctiveness Conflict Risk

'Tessl tiles' establishes a clear niche with domain-specific triggers like 'prepare for tessl publish'. However, 'test this skill' and 'measure skill value' are somewhat generic phrases that could overlap with a generic skill-testing skill, giving minor overlap risk rather than the minimal risk of anchor 5.

4 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

ericjohnolson/tessl-test

Path

.tessl/tiles/tessl-labs/tessl-skill-eval-scenarios/creating-eval-scenarios/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.