CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

add-model

Add a new LLM model to apps/sim/providers/models.ts with specs verified against the provider's live API docs (no hallucination)

65

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary operational skill: every step is executable, validation and feedback loops are explicit at each stage, and nearly all content is repo-specific knowledge Claude could not reconstruct. The only real gaps are mild redundancy around the UNVERIFIED/ask-user protocol and a monolithic single-file layout where large lookup tables could be split into a reference file.

DimensionReasoningScore

Conciseness

The body is dense with non-obvious, repo-specific facts (Consumption Matrix, hosted-billing rules, test touchpoints) and almost never explains concepts Claude already knows. Not 5: the "mark UNVERIFIED and ask the user before guessing" instruction is repeated across Hard rules, Step 6, and the closing section, and a few sentences could be trimmed without losing information.

4 / 5

Actionability

Fully executable throughout: exact commands (rg "reasoningEffort|reasoning_effort" …, bun run lint, bun run generate:agent-stream-docs), a copy-paste TypeScript entry template, a verbatim WebFetch prompt with explicit field list, per-provider documentation URLs, and a mandatory verification-report format. Specific examples cover the common cases.

5 / 5

Workflow Clarity

A numbered task overview is followed by sequenced Steps 1–6 with explicit validation checkpoints and feedback loops: lint must pass before reporting done, CI-diffed docs regeneration, re-grep before trusting the matrix, the getHostedModels() billing assertion, per-field verification status, and ask-the-user gates with error-recovery paths ("If anything matches, run the affected provider tests and update assertions").

5 / 5

Progressive Disclosure

A single self-contained file (no references/, scripts/, or assets/ exist in the bundle) with well-organized, clearly headed sections that are easy to navigate. Not 5: at ~200 lines it exceeds the simple-skill exception, and large lookup tables (the Consumption Matrix, the per-provider URL table) are plausible candidates for a separate reference file; not 3 because nothing is buried and the structure is genuinely good.

4 / 5

Total

18

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A precise, distinctive description that clearly states what the skill does, but it entirely lacks a "when to use" trigger clause, which caps completeness. Adding an explicit "Use when…" clause with natural trigger phrases (e.g., "Use when adding a new model to the provider catalog or when the user asks to add/update a model's pricing or specs") would lift both completeness and trigger-term quality.

Suggestions

Add an explicit trigger clause, e.g., "Use when a new LLM/model is released or when the user asks to add a model, update model pricing, or register a model in the provider catalog."

Include natural synonyms users would say — "model pricing", "model catalog", "model entry" — to broaden trigger-term coverage beyond "Add a new LLM model".

Optionally hint at the wider scope (capability flags, hosted billing checks) so the description matches the skill's actual coverage and improves the specificity score.

DimensionReasoningScore

Specificity

Names two concrete actions — "Add a new LLM model to apps/sim/providers/models.ts" and "specs verified against the provider's live API docs" — anchored to an exact file path. It falls short of 5 because it omits real parts of the skill's coverage (capability-flag consumption checks, hosted billing, test touchpoints), and sits above 3 because the actions are far more precise than the '1-2 concrete actions, not comprehensive' anchor.

4 / 5

Completeness

The "what" is explicit and precise (add a model entry with live-doc-verified specs to a named file), but there is no "Use when…" clause or equivalent trigger guidance — the "when" is only weakly implied by the imperative. Per the rubric guideline, a missing trigger clause caps completeness at 3; it is not 2 because the "what" is clear rather than vague.

3 / 5

Trigger Term Quality

"Add a new LLM model" and "provider" are natural phrases a user would say when needing this skill, giving good keyword coverage. Not 5: common variations and synonyms (e.g., "model pricing", "model catalog", "model entry", specific provider names) are missing.

4 / 5

Distinctiveness Conflict Risk

The description is tied to one exact file path and a narrow, well-defined task — a clear niche with distinct triggers and minimal risk of firing for the wrong skill.

5 / 5

Total

16

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

simstudioai/sim

Path

.agents/skills/add-model/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.