CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/vector-search-recall-tests

Vector search benchmarking - recall@k vs latency tradeoffs, ground-truth construction via brute-force, HNSW tuning (M / ef_construct / ef per Qdrant docs), embedding-model-upgrade drift detection. Use ANN-Benchmarks framework for cross-engine comparison; per-engine clients (Qdrant, Weaviate, pgvector, Pinecone, Elasticsearch k-NN, Milvus) for in-product tests. Use when HNSW / IVF parameters are being tuned or an embedding model is swapped, and recall@k on the existing corpus has never been measured against brute-force ground truth.

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is concise, highly actionable with executable code and concrete thresholds, sequenced as a clear validated workflow, and uses progressive disclosure with two real, well-linked reference files. It is strong across all dimensions with no notable weaknesses.

DimensionReasoningScore

Conciseness

The body is lean: it skips explaining what vector search or HNSW is, jumps straight to runnable code and tables, and every section earns its tokens with concrete measurement/parameter-sweep guidance, matching the level-3 'lean and efficient; assumes Claude's competence' anchor.

3 / 3

Actionability

It provides fully executable Python (NearestNeighbors brute-force, recall_at_k, qdrant_client query_points with SearchParams(hnsw_ef=...), latency percentiles, embedding-upgrade test) plus a parameter table and concrete thresholds (recall@10 >= 0.95, p95 < 50ms), matching the level-3 'fully executable code/commands; copy-paste ready' anchor.

3 / 3

Workflow Clarity

The eight numbered steps form a clear sequence (ground truth -> recall -> HNSW sweep with latency pairing -> latency budget -> drift -> cross-engine -> filters -> rebuild), and batch/destructive operations carry explicit validation in the form of assert thresholds (e.g. assert delta >= -0.05, assert new_recall >= initial_recall - 0.05) with the anti-pattern table as a feedback loop, satisfying the level-3 anchor of explicit checkpoints for risky operations.

3 / 3

Progressive Disclosure

The SKILL.md is an overview with engine-agnostic core logic inline, and detail that would bloat it (clone-and-run ANN-Benchmarks commands, per-engine client code and deprecated APIs) is split into two well-signaled, one-level-deep reference files (references/ann-benchmarks.md, references/per-engine-clients.md) that both exist and are linked inline, matching the level-3 'clear overview with well-signaled one-level-deep references' anchor.

3 / 3

Total

12

/

12

Passed

Description

77%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is highly specific, complete with explicit 'what' and 'when' triggers, and occupies a distinctive niche. Its only mild weakness is trigger-term naturalness, as much of the phrasing is engine-specific jargon rather than user-voiced terms.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — 'recall@k vs latency tradeoffs', 'ground-truth construction via brute-force', 'HNSW tuning (M / ef_construct / ef ...)', and 'embedding-model-upgrade drift detection' — matching the level-3 anchor of multiple specific concrete actions.

3 / 3

Completeness

It explicitly answers 'what' (benchmarking, ground-truth construction, HNSW tuning, drift detection) and 'when' via the explicit 'Use when HNSW / IVF parameters are being tuned or an embedding model is swapped, and recall@k ... has never been measured against brute-force ground truth' clause, satisfying the level-3 anchor.

3 / 3

Trigger Term Quality

It includes relevant terms a user might say ('vector search', 'recall@k', 'embedding model', 'HNSW'), but the phrasing leans technical/internal ('recall@k vs latency tradeoffs', 'brute-force ground truth', 'ef per Qdrant docs') rather than the natural variations a non-expert would voice, so coverage is good but not comprehensive.

2 / 3

Distinctiveness Conflict Risk

The niche is narrow and clearly distinct — measuring recall@k against brute-force ground truth and HNSW/embedding-drift testing — with triggers unlikely to fire for unrelated skills, matching the level-3 'clear niche with distinct triggers' anchor.

3 / 3

Total

11

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents