CtrlK
BlogDocsLog inGet started
Tessl Logo

new-provider

Add a new LLM provider to hermesllm. Use when integrating a new AI provider.

72

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a tight, highly actionable checklist with exact code locations and a concrete verification command, well-organized for a simple single-purpose skill. The only minor gap is the absence of an explicit failure-retry loop after the test step.

DimensionReasoningScore

Conciseness

The body is lean and efficient: an intro line, a numbered list of exact paths and types, and a validation command, with no explanation of concepts Claude already knows, matching the score-3 anchor; it is not padded like the score-1 example.

3 / 3

Actionability

It gives concrete, executable guidance — exact file paths, enum names, a TryFrom<&str> impl, provider_models.yaml, and the copy-paste command 'cd crates && cargo test --lib' — matching the score-3 anchor for fully executable, copy-paste-ready instructions.

3 / 3

Workflow Clarity

A clear numbered sequence (1-6) is paired with an explicit validation checkpoint ('run cargo test --lib to verify everything compiles and tests pass'), exceeding the score-2 example which only says 'Test the output'; it is not a destructive/batch operation that would cap at 2, though a failure-retry loop is absent.

3 / 3

Progressive Disclosure

The skill is under 50 lines, single-purpose, and has no bundle files or external references; per the scoring notes it scores 3 with well-organized sections, which the numbered list and validation step provide.

3 / 3

Total

12

/

12

Passed

Description

75%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise and clearly answers both what and when with an explicit trigger, anchored to a specific project. Its main weakness is limited trigger-term coverage and a single stated action rather than multiple concrete capabilities.

Suggestions

Broaden trigger terms to include natural variations a user might say, e.g. 'Use when adding or integrating a new LLM/AI model provider (e.g. OpenAI, Anthropic) into hermesllm.'

List a couple of concrete sub-actions in the description (e.g. 'register the provider, add request/response types, and update the model list') to lift specificity to the top anchor.

DimensionReasoningScore

Specificity

Names the domain ('hermesllm', 'LLM provider') and a single action ('Add a new LLM provider'), but does not list multiple specific concrete actions like the score-3 anchor; it is not vague/abstract like the score-1 anchor.

2 / 3

Completeness

It answers both what ('Add a new LLM provider to hermesllm') and when with an explicit 'Use when integrating a new AI provider.' trigger, satisfying the score-3 anchor; a missing 'Use when' clause would have capped it at 2.

3 / 3

Trigger Term Quality

Relevant terms ('new LLM provider', 'new AI provider', 'integrating') are present and natural, but coverage is limited and misses common variations a user might say (specific provider names, 'model provider'), matching the score-2 anchor.

2 / 3

Distinctiveness Conflict Risk

The named project 'hermesllm' gives a clear niche and the trigger is anchored to that project, making it unlikely to fire for unrelated skills, matching the score-3 anchor.

3 / 3

Total

10

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
katanemo/plano
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.