CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

vector-index-tuning

Optimize vector index performance for latency, recall, and memory. Use when tuning HNSW parameters, selecting quantization strategies, or scaling vector search infrastructure.

61

Quality

77%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./plugins/llm-application-dev/skills/vector-index-tuning/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

55%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured overview with genuine tuning reference material and correct use of a single one-level-deep reference file. Its weaknesses are procedural: there is no sequenced tuning workflow with validation checkpoints, and no executable guidance lives in SKILL.md itself, leaving the reader to assemble a procedure from tables and best-practice bullets.

Suggestions

Add an explicit tuning workflow with validation checkpoints — e.g. 1. Benchmark current recall/latency with real queries, 2. Change one parameter at a time starting with efSearch, 3. Re-measure against the baseline, 4. Accept only if recall holds, otherwise roll back — rather than leaving the procedure implicit in the do's/don'ts.

Include one small executable snippet or command in SKILL.md (e.g. a minimal hnswlib index.set_ef() + recall check, or a benchmark one-liner) so the body is actionable on its own, with the full template library staying in references/details.md.

Enumerate the contents of references/details.md at the pointer (HNSW parameter tuning, quantization strategies, Qdrant index configuration, performance monitoring) so Claude knows which template to jump to, and trim the 'When to Use This Skill' section that duplicates the frontmatter description.

DimensionReasoningScore

Conciseness

Mostly lean — decision tables and byte-cost comparisons carry real tuning value with no padded prose. Two things could be trimmed: the 'When to Use This Skill' section duplicates the frontmatter description almost verbatim, and the HNSW table explains what M/efConstruction/efSearch fundamentally are, which Claude already knows. Not anchor 5 because those tokens don't fully earn their place.

4 / 5

Actionability

Concrete inputs are present — default values (M=16, efConstruction=100, efSearch=50), an index-type selection heuristic keyed to data size, and quantization byte costs — but no executable guidance in the body itself: no code, no commands, no measurement procedure. Anchor 3 fits ('some concrete guidance but incomplete; missing key details'); the executable templates are entirely deferred to references/details.md with no inline quick-start snippet.

3 / 5

Workflow Clarity

No tuning sequence is defined anywhere in the body — nothing ordered like 'benchmark baseline → adjust efSearch → re-measure recall → accept or roll back'. The do's/don'ts loosely imply a lifecycle (start with defaults, benchmark, monitor, reindex) but never sequence it, and there are no validation checkpoints, which is anchor 2 territory ('rough sequence present but many gaps; validation absent') rather than a defined workflow.

2 / 5

Progressive Disclosure

Good structure against the actual bundle: SKILL.md is a ~65-line overview, one reference file (references/details.md) exists, is one level deep (no nested references inside it), and is clearly signaled in a dedicated section with when to read it ('Read that file when you need the concrete templates'). Just short of anchor 5 because the pointer doesn't enumerate what the file contains — naming the four templates (HNSW tuning, quantization, Qdrant config, monitoring) would make navigation easier.

4 / 5

Total

13

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third person, concise, explicit what-and-when with concrete domain-specific triggers. The only real gap is coverage of common synonyms (embeddings, ANN, vector database, tool names) that would broaden natural triggering.

DimensionReasoningScore

Specificity

The description names the domain and several concrete actions — 'Optimize vector index performance for latency, recall, and memory' plus 'tuning HNSW parameters, selecting quantization strategies, or scaling vector search infrastructure'. It sits between anchor 3 (only 1-2 concrete actions) and anchor 5: several specific actions are listed, but the lead verb 'optimize performance' is somewhat generic and a few concrete actions are implied rather than named.

4 / 5

Completeness

Both parts are explicit: the what ('Optimize vector index performance for latency, recall, and memory') and a concrete when ('Use when tuning HNSW parameters, selecting quantization strategies, or scaling vector search infrastructure'). This matches anchor 5 — clear what plus explicit 'Use when...' with concrete trigger phrases — and exceeds anchor 4, where the when is only serviceable.

5 / 5

Trigger Term Quality

Strong natural terms a user tuning vector search would actually say: 'HNSW parameters', 'quantization strategies', 'vector search', 'recall', 'latency'. Not anchor 5 because common synonyms and ecosystem terms are missing — 'embeddings', 'ANN'/'approximate nearest neighbor', 'vector database', and tool names like Qdrant, pgvector, FAISS, or Pinecone.

4 / 5

Distinctiveness Conflict Risk

The niche is well carved out — HNSW, quantization, and vector search infrastructure are distinct triggers that no generic skill would claim. Terms like 'vector index', 'recall', and 'HNSW' anchor it firmly; conflict risk with adjacent performance-tuning skills is minimal.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

wshobson/agents

Path

plugins/llm-application-dev/skills/vector-index-tuning/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.