CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

martinfrancois/build-a-skill

An Agent Skill that builds a skill with evals out of the conversation in which the agent finally got it right.

84

1.71x
Quality

98%

Does it follow best practices?

Impact

96%

1.71x

1 of 3 eval scenarios. Add 2 more for a full score.

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

100%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a dense but disciplined procedure: nine ordered steps, each with concrete commands, named files, explicit validation and feedback loops, stop rules against retry spirals, and a closing completion checklist. Detail is pushed to four real, leaf-level reference files that are precisely signaled by a read-it-when table, and the only mild pressure point is step 8's packed paragraph, though every clause in it is operational (usage gate, fallback screen, score threshold, retry cap).

DimensionReasoningScore

Conciseness

The body assumes Claude's competence throughout and spends tokens only on non-obvious operational knowledge, e.g. "copy everything under assets/template/ into that directory with cp -r, from the resolved path of this skill (readlink -f), because an installed skill is usually a symlink" and "never retype the template by hand, which loses file modes and invites typos". There is no explanation of concepts Claude already knows; the only candidate for trimming (the short intro) defines terms ("the version that stayed") used by later steps, so it earns its place.

5 / 5

Actionability

Every step carries executable commands or exact edit targets: "git log --before", "cp -r", "git init", "python3 scripts/validate_eval_criteria.py evals evals-reference evals-regression", "tessl project create <name> --workspace <workspace>", "tessl org usage --json", and "scripts/local_screen.sh", along with the named files to edit (tessl.json, .tessl-plugin/plugin.json, README.md). Commands are copy-paste ready and cover the common cases; per the rubric's instruction-skill note, this is fully actionable.

5 / 5

Workflow Clarity

The nine-step sequence is clearly ordered with explicit validation checkpoints and feedback loops: "Run python3 scripts/validate_eval_criteria.py ... until it passes", "If it differs in the habit the skill teaches, fix the skill (never the prompt) and replay again", and the credit gate "if credits.overLimit is true or credits.remaining is below the run's estimate, do not run it". A stop rule ("At most three runs per scenario per change; if a run is stuck or a score does not move, stop and report") and a closing done-check ("The task is done when the replay produces the version that stayed, every with-skill scenario scores 100...") complete the error-recovery loop.

5 / 5

Progressive Disclosure

The body is a lean overview with a References table that signals exactly when to open each file ("You need the session transcript on disk", "You write or revise SKILL.md"); all four references/ files exist and contain no further links, so navigation is one level deep. Every path cited from the bundle (assets/template/README.md, scripts/validate_eval_criteria.py, scripts/local_screen.sh, docs/agents/local-screening.md) exists in assets/template/, matching the anchor for a clear overview with well-signaled one-level-deep references.

5 / 5

Total

20

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: it states a concrete multi-step capability in third person, enumerates the exact user phrasings that should fire it (including the case where the user never says 'skill'), and explicitly delimits what it is not for. Its length is at the upper bound but every clause carries a distinct trigger or scope decision rather than padding.

DimensionReasoningScore

Specificity

Multiple concrete actions are named: "writes the skill and one eval per correction", "replays the first prompt with the skill installed to check it gets it right the first time", and "scores the evals with and without it", plus an explicit scope exclusion ("Not for writing a skill from scratch"). Coverage is comprehensive with no vague filler, matching the anchor for multiple specific concrete actions; the score-4 anchor ('minor gaps in coverage') fits worse since every phase of the work is named.

5 / 5

Completeness

Both questions are answered explicitly: the 'what' is the full pipeline ("Builds an Agent Skill with evals out of the current conversation... writes the skill and one eval per correction, replays the first prompt... and scores the evals with and without it") and the 'when' is a full "Use whenever the user asks to..." clause with multiple concrete trigger phrases, plus a negative scope clause. This matches the anchor 'clearly and explicitly answers both what AND when with concrete trigger phrases'; the 'when' is not merely present but enumerated.

5 / 5

Trigger Term Quality

Natural user phrasings are covered comprehensively: "turn this conversation, these corrections, or this fix into a skill", "make the agent remember this or stop repeating a mistake", and "the agent finally got it right and should keep doing it this way, even if they never say 'skill'" — the last even covers the synonym case where the trigger word is absent. No natural variation is missing; file extensions are not applicable to this conversational trigger domain.

5 / 5

Distinctiveness Conflict Risk

The niche is distinct — building a skill from an existing conversation with corrections — and the explicit boundary "Not for writing a skill from scratch with no conversation behind it" fences off the nearest competing skill type. Triggers are conversational and specific ("stop repeating a mistake", "keep doing it this way"), giving minimal conflict risk; the score-4 anchor's 'minor overlap risk' is already addressed by the explicit exclusion.

5 / 5

Total

20

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 1 deeper-than-1-level

Warning

referenced_paths_exist

Referenced path issues: 2 missing, 2 deeper-than-1-level

Warning

Total

14

/

16

Passed

Reviewed

On this page