CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

chat-perf

Run chat perf benchmarks and memory leak checks against the local dev build or any published VS Code version. Use when investigating chat rendering regressions, validating perf-sensitive changes to chat UI, or checking for memory leaks in the chat response pipeline.

68

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is chat-perf in microsoft/vscode

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An unusually actionable skill document — every workflow is backed by exact, copy-paste-ready commands, and the regression-pinpointing and resume flows include real validation checkpoints and feedback loops. Its weaknesses are structural: duplicated statistical guidance across two sections with repeated run-count advice and aging version pins hurt token efficiency, and reference-grade material (CI artifacts, architecture) is inlined in a single long file instead of being split into bundled reference files.

Suggestions

Merge the "Statistical significance" and "Statistics" sections into one place and state the run-count guidance ("5+ runs, 10+ to detect 20% regressions") only once instead of three times.

Move the CI artifact-retention tables and the architecture/mock-server details into bundled reference files (e.g. references/ci-artifacts.md, references/architecture.md) linked from a short overview section in SKILL.md.

Avoid hard-coded version pins in prose ("1.115.0" as baseline default, "1.122.0" in the CI example) — point readers to config.jsonc or `--help` as the source of truth so the text does not go stale.

DimensionReasoningScore

Conciseness

The body assumes Claude's competence (no basic-concept explanations; everything is repo-specific), but statistical methodology is split across "Statistical significance" and "Statistics" sections that both explain Welch's t-test and run-count guidance, the "5+ runs" advice is repeated three times, and hard-coded version pins ("1.115.0", "1.122.0") will age. This matches anchor 3 — mostly efficient but with unnecessary duplication that could be tightened — rather than the minor-trimming level of anchor 4.

3 / 5

Actionability

Fully executable throughout: copy-paste quick-start commands, a complete flag table with defaults, exact `gh` CLI invocations with `--jq` filters, defined exit codes, and numeric interpretation thresholds ("0.3–1.0 MB/msg — normal", ">2.0 MB/msg — likely leak"). Commands cover all the common cases (local vs. release, two local builds, resume, CI inspection).

5 / 5

Workflow Clarity

Multi-step processes are clearly sequenced with explicit validation checkpoints: the four-step regression pinpointing workflow includes "Confirm it's real vs. measurement noise" with bimodal-signature guidance, statistical-significance gating acts as a validation gate before flagging, and the `--resume` flow is a genuine feedback loop for inconclusive results. Anchor 5's requirements (explicit validation, error-recovery loops) are met; the operations are non-destructive so no batch-validation cap applies.

5 / 5

Progressive Disclosure

Section headers are clear and quick-start content comes first, but this is a 313-line monolithic SKILL.md with no bundle files. The CI artifact-retention reference (~45 lines of tables and gh commands) and the architecture/mock-server internals are inline content that clearly belongs in separate reference files, matching anchor 3's "content that should be separate is inline" rather than anchor 4's "most content is appropriately placed".

3 / 5

Total

16

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capabilities, explicitly scoped targets, and a well-formed "Use when" clause with three realistic trigger scenarios. Third-person imperative voice is used correctly and there is no fluff or over-claiming. Only minor headroom in action breadth and natural-synonym coverage.

DimensionReasoningScore

Specificity

Names two concrete capabilities — "Run chat perf benchmarks" and "memory leak checks" — with precisely specified targets ("local dev build or any published VS Code version"). The action count matches anchor 3, but the concreteness of the targets and scope places it noticeably above that anchor, between 3 and 4.

4 / 5

Completeness

Explicitly answers both questions: "what" (run perf benchmarks and memory leak checks against local dev or published VS Code builds) and "when" (three concrete trigger scenarios introduced by "Use when..."). This mirrors the anchor-5 example structure; there is no gap that would justify 4.

5 / 5

Trigger Term Quality

Good natural-phrase coverage: "chat rendering regressions", "perf-sensitive changes to chat UI", "memory leaks in the chat response pipeline" are phrasings a user would plausibly say. A few natural synonyms (e.g. "chat is slow", "jank", "streaming performance") are missing, so it does not reach anchor 5.

4 / 5

Distinctiveness Conflict Risk

Clear niche — VS Code chat performance benchmarking and leak detection — with triggers distinct from adjacent concerns like heap snapshot analysis or general perf optimization. Minimal risk of triggering the wrong skill.

5 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 4 missing, 3 deeper-than-1-level

Warning

Total

15

/

16

Passed

Repository

posit-dev/positron

Path

.github/skills/chat-perf/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.