CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

customizations-in-the-agent-host

Architecture and hard-won debugging lessons for customization enablement (plugins, MCP servers, agents, skills, instructions) in the agent host. Use when changing how customizations are discovered, published, enabled/disabled, or handed to a provider SDK; when a customization shows the wrong enabled state in the UI; or when a disabled MCP server or plugin is still reaching the model.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

90%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary knowledge-skill body: dense with non-obvious, battle-tested specifics, concrete commands and identifiers, and an explicit validation section. The only structural headroom is adding an explicit error-recovery loop in the debugging workflow and potentially splitting enforcement/gotcha detail into reference files.

DimensionReasoningScore

Conciseness

Nearly every sentence carries project-specific, hard-won information — invariants ('_setClientGlobal must never touch _persistent'), file paths, and failure cases — with zero padding and no explanation of concepts Claude already knows (no generic 'what is an MCP server' material). It assumes competence throughout, matching the lean top anchor.

5 / 5

Actionability

Guidance is fully concrete and executable for an instruction-only skill: exact source files and functions ('targetForMcpServer()', 'resolveCustomizationEnablement()', 'createNoopCustomizationEnablementService()'), a specific log signature ('tool_search override … clientMatched=[…]' in 'Agent Host.log'), and copy-paste validation commands ('pnpm run typecheck-client', test scripts with --grep/--runGlob patterns).

5 / 5

Workflow Clarity

The debugging playbook gives a ranked signal checklist and a sequenced cross-session reproduction recipe, and the Validation section supplies explicit checkpoint commands. However, there is no explicit validate→fix→retry error-recovery loop and the core guidance ('route every path through resolution') is a rule rather than a step sequence, so it sits below the top anchor.

4 / 5

Progressive Disclosure

Well-organized single-file body with clear sections (mental model, enforcement, playbook, gotchas, validation) and a clearly signaled one-level reference to agent-host-uri-spaces.instructions.md, plus pointers to the agent-host-logs and launch skills. All content lives inline in one ~125-line file with no bundle files to split into, which is well-structured but stops short of the overview-plus-reference-files pattern of the top anchor.

4 / 5

Total

18

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete domain framing, and an explicit multi-scenario 'Use when' clause covering change-time, UI-state, and enforcement-failure triggers. Only slight headroom exists in action phrasing and natural-term synonyms.

DimensionReasoningScore

Specificity

Names the domain concretely ('customization enablement (plugins, MCP servers, agents, skills, instructions) in the agent host') and lists several specific conditions ('discovered, published, enabled/disabled, or handed to a provider SDK', 'wrong enabled state in the UI'), but the opening 'Architecture and hard-won debugging lessons' describes content type rather than concrete actions, leaving minor gaps versus the comprehensive anchor.

4 / 5

Completeness

Explicitly answers both what ('Architecture and hard-won debugging lessons for customization enablement... in the agent host') and when, with three concrete trigger phrases ('Use when changing how customizations are discovered, published, enabled/disabled, or handed to a provider SDK; ...wrong enabled state in the UI; ...disabled MCP server or plugin is still reaching the model'). This matches the top anchor; the 'when' is explicit and specific, so the 4 anchor ('when could be more explicit') does not fit.

5 / 5

Trigger Term Quality

Good natural keyword coverage — 'plugin', 'MCP server', 'enabled/disabled', 'wrong enabled state in the UI', 'disabled MCP server or plugin is still reaching the model' — phrased the way a developer would actually describe the problem. A few natural variations ('toggle', 'turning off', 'not taking effect', 'persist') are missing, so it falls just short of the comprehensive-synonyms anchor.

4 / 5

Distinctiveness Conflict Risk

A clear niche — enablement state of customizations in this agent host — with distinct triggers ('wrong enabled state in the UI', 'disabled MCP server still reaching the model') that would not naturally fire sibling skills. It is far more specific than the 'minor overlap risk' anchor, which envisions broad multi-domain phrasing.

5 / 5

Total

18

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 1 suspicious

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

microsoft/vscode

Path

.github/skills/customizations-in-the-agent-host/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.