CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

chat-customizations-editor

Use when working on the Chat Customizations editor — the management UI for agents, skills, instructions, hooks, prompts, MCP servers, and plugins.

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

90%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally dense, repo-specific reference that assumes Claude's competence and provides copy-paste-ready commands, code, and diagnostics throughout. The only notable gaps are the lack of an explicit verification step in the fixture-creation workflow and inline fixture/mock detail that could be split into a reference file.

Suggestions

Add an explicit validation step to the add-fixture workflow (e.g., 'screenshot the new fixture via mcp_component-exp_screenshot and confirm both Dark and Light variants render before setting blocksCi').

Move the 11-row fixture-ID table and the per-type mock-data requirements into a references file, keeping SKILL.md as an overview with a clearly signaled pointer.

Make the layout-debugging loop an explicit numbered validate → fix → re-diagnose sequence rather than relying on the reader to combine the eval diagnostics with the common-issues table.

DimensionReasoningScore

Conciseness

Nearly every line carries non-derivable repo knowledge — file paths, interface names, fixture IDs, exact mock methods, CI gate labels — with no explanations of concepts Claude already knows and no padding. This matches anchor 5 ('lean and efficient; assumes Claude's competence; every token earns its place') rather than 4, which would require identifiable over-explanation to trim.

5 / 5

Actionability

Guidance is fully executable and copy-paste ready: runnable commands ('./scripts/test.sh --grep "applyStorageSourceFilter|customizationCounts"', 'pnpm run typecheck-client'), complete code blocks for adding a tab fixture and for @playwright/cli eval diagnostics, and exact mock method names per customization type. It matches anchor 5's 'copy-paste ready code or commands; specific examples cover the common cases'.

5 / 5

Workflow Clarity

The main workflows are clearly sequenced with most checkpoints present: the five-layer sync table for API changes with 'verify both core and sessions registrations compile', CI regression gates that 'fail the CI status check' on screenshot changes, and a symptom/root-cause/fix table with error-recovery guidance for layout debugging. It falls short of anchor 5 because the add-fixture workflow has no explicit validate-rendered-output step, and the debugging loop's fix-then-recheck cycle is implied by the table rather than an explicit feedback loop.

4 / 5

Progressive Disclosure

No bundle files exist, so this is a single-file skill; external pointers (the spec at 'src/vs/sessions/AI_CUSTOMIZATIONS.md', '.github/instructions/ai-customization.instructions.md', and the 'component-fixtures'/'sessions'/'launch' skills) are clearly signaled with purpose and are one level deep. This matches anchor 4 ('good structure; most content is appropriately placed; minor organization gaps') rather than 5 because the 11-row fixture-ID table and the detailed mock-service requirements are inline content that could plausibly live in a reference file.

4 / 5

Total

18

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A well-scoped, appropriately concise description that names a specific editor and its full item inventory with an explicit 'Use when' trigger. Its main weakness is the absence of concrete action verbs and skill-function statements, leaving the 'what' indirect and the trigger vocabulary slightly narrow.

Suggestions

Add one or two concrete action verbs describing what the skill helps with, e.g., 'Navigate the key interfaces, keep the extension-API layers in sync, and add component fixtures when changing the Chat Customizations editor'.

Include a synonym or two for the editor itself (e.g., 'customizations pane' or 'Open Customizations view') so users phrasing the trigger differently still match.

State the skill's function explicitly (provides folder maps, interface contracts, and testing/debugging workflows) rather than only identifying the target artifact.

DimensionReasoningScore

Specificity

The description names the exact target ('the Chat Customizations editor') and enumerates all seven managed item types ('agents, skills, instructions, hooks, prompts, MCP servers, and plugins'), giving concrete scope, but the only action is the generic 'working on' — no concrete verbs like edit, add, or debug. It sits between anchor 2 (generic actions) and anchor 3, earning 3 because the thorough item enumeration supplies concrete grounding the anchor-2 example lacks.

3 / 5

Completeness

Both parts are present: an explicit trigger clause ('Use when working on the Chat Customizations editor') and a 'what' ('the management UI for agents, skills, instructions, hooks, prompts, MCP servers, and plugins'). It matches anchor 4 rather than 5 because the 'what' identifies the artifact being worked on rather than explicitly stating what the skill itself provides (navigation, interfaces, testing guidance).

4 / 5

Trigger Term Quality

It includes natural terms users would say when working in this area ('Chat Customizations editor', 'agents', 'skills', 'hooks', 'prompts', 'MCP servers', 'plugins'), matching anchor 4's 'good keyword coverage; a few natural terms missing'. It is not a 5 because synonyms for the editor itself (e.g., 'customizations pane', 'manage customizations', 'Open Customizations') are absent.

4 / 5

Distinctiveness Conflict Risk

The trigger is scoped to a specific named editor with a clear niche, but the enumerated generic nouns ('skills', 'hooks', 'prompts') create minor overlap risk with skills about those items individually — anchor 4 ('mostly distinct; minor overlap risk') rather than 5.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Repository

microsoft/vscode

Path

.github/skills/chat-customizations-editor/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.