CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

setup-skill-performance

Generate eval scenarios from a Tessl plugin (a packaged skill bundle), run baseline + with-context evals, and present results. Use when setting up an evaluation pipeline, running benchmarks, generating test scenarios, measuring skill performance or accuracy, scoring how well a skill helps agents solve tasks, or evaluating skill effectiveness before publishing.

1.14x
Quality

87%

Does it follow best practices?

Impact

89%

1.14x

Average score across 29 eval scenarios

SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is tessl/skill-optimizer

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-orchestrated multi-phase skill body: clear sequencing, scope selection, validation gating before expensive eval runs, and textbook progressive disclosure to existing, well-signaled reference files. The main gaps are minor duplication with references, full command syntax living only in the reference files, and no in-body error-recovery loop for failed quality checks or non-firing activation.

Suggestions

Trim the duplicated activation-eval explanation in Phase 4a to one line and cut the run-label example list from seven to three representative examples; the full detail already lives in references/phase4-run-evals.md and the label guidance.

Inline the primary command for each phase (e.g., 'tessl scenario generate <plugin-path> --label <run-label>') so the body is copy-paste executable without opening a reference for the common cases.

Add a short recovery pointer per gate, e.g., 'if the Phase 3 quality-check fails or Phase 4a shows no firing, see references/phase3-download-scenarios.md §3.x before proceeding', to give the workflow an explicit feedback loop in the body.

DimensionReasoningScore

Conciseness

The body is efficient and assumes competence — no concept explanations, just operational guidance (scope menu, time expectations, label rules, phase map). Minor trimming opportunities exist: the Phase 4a explanation ('Activation does NOT force a skill to fire — it tests routing/description quality. Applies to all plugins...') duplicates detail that also lives in references/phase4-run-evals.md, and the seven run-label examples could be cut to three. Fits 'Efficient; minor instances of over-explanation that could be trimmed'; not 5 because of that duplication, not 3 because there is no genuinely unnecessary explanation.

4 / 5

Actionability

The body provides concrete, executable guidance: exact eval flags ('--skip-forced-context-activation --skip-scoring'), a verbatim user-facing scope question, a choice-to-phases mapping table, concrete label examples, and time expectations. However, the full copy-paste commands per phase (e.g., the complete 'tessl scenario generate' invocation) live only in the reference files, so guidance is 'mostly executable... with minor gaps' rather than fully copy-paste ready in the body itself. Not 3, since nothing is pseudocode or vague.

4 / 5

Workflow Clarity

Phases 1–6 are clearly sequenced with a scope-mapping table, explicit 4a/4b ordering rules, gating validation in Phase 3 (verify structure, quality-check for anti-patterns, fixture detection 'before proceeding'), Phase 4a as a routing gate that 'prevent[s] wasted content-eval time', and a 'When to stop' section. It falls short of anchor 5 because explicit error-recovery feedback loops (e.g., what to do when the Phase 3 quality-check fails or when no skill fires in 4a) are not stated in the body — recovery is delegated to references and the companion skill.

4 / 5

Progressive Disclosure

The body is a clean overview where every phase links to exactly one clearly signaled reference file, and all seven referenced files (phase1–phase6 plus phase3-fixtures-and-setup.md) exist in references/. The one nested file (phase3-fixtures-and-setup.md, loaded by phase3-download-scenarios.md) is explicitly named and scoped in the body ('that file owns the signals, skip rules, sourcing procedure, and pre-run summary format'), so navigation stays clear; 'For partial runs, skip phases not in scope — don't load their reference files' adds explicit loading discipline. Matches 'Clear overview with well-signaled one-level-deep references... easy navigation'.

5 / 5

Total

17

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with a clear third-person what-clause and an explicit, multi-phrase 'Use when' trigger clause. The only weaknesses are minor: pipeline coverage skips a couple of steps it actually performs, and 'measuring skill performance' mildly overlaps the companion optimization skill's territory.

DimensionReasoningScore

Specificity

The description names three concrete actions — 'Generate eval scenarios from a Tessl plugin (a packaged skill bundle), run baseline + with-context evals, and present results' — which is several specific actions, but it omits parts of the pipeline it actually covers (downloading scenarios, quality-checking for rubric anti-patterns, activation checks), leaving minor gaps in coverage. This matches the anchor 'Lists several specific actions; minor gaps in coverage' rather than 5, whose example lists four-plus actions with comprehensive coverage.

4 / 5

Completeness

It explicitly answers both questions: 'what' via 'Generate eval scenarios... run baseline + with-context evals, and present results', and 'when' via an explicit 'Use when setting up...' clause with multiple concrete trigger phrases. This is a direct match to the anchor-5 example pattern; not 4, because the 'when' clause is fully explicit and specific rather than needing more detail.

5 / 5

Trigger Term Quality

The 'Use when' clause covers seven natural trigger phrasings with good synonym variation: 'setting up an evaluation pipeline', 'running benchmarks', 'generating test scenarios', 'measuring skill performance or accuracy', 'scoring how well a skill helps agents solve tasks', 'evaluating skill effectiveness before publishing'. These are phrases a user would naturally say, giving comprehensive coverage; no file extensions apply to this domain. Anti-drift check: anchor 4 ('a few natural terms missing') fits worse than the comprehensive synonym coverage shown here.

5 / 5

Distinctiveness Conflict Risk

The Tessl-plugin eval-setup niche is mostly distinct with clear triggers, but there is minor overlap risk with the closely related companion skill ('optimize-skill-performance'), since phrases like 'measuring skill performance or accuracy' could plausibly fire for either the setup or the analysis/optimization skill. Fits 'Mostly distinct; minor overlap risk with closely related skills'; not 5 because of that companion-skill overlap, not 3 because the domain is far more specific than 'Works with document files'.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

tesslio/product-plugins

Path

skill-optimizer/skills/setup-skill-performance/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.