CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/hybrid-search-eval-author

Evaluates hybrid retrieval pipelines (BM25 + vector + reranker) end-to-end: authors ground-truth judgment sets, computes nDCG@k and MRR over fused results, measures the lift from Reciprocal Rank Fusion vs weighted fusion vs single-stage retrieval, and quantifies reranker (cross-encoder/Cohere/bge) impact. Use when a production system combines lexical and semantic retrieval and you need a numeric relevance baseline, fusion-strategy comparison, or evidence that a reranker is earning its latency cost.

79

Quality

99%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable skill: clear sequenced 7-step workflow with a CI validation gate, executable code throughout, and clean progressive disclosure into two real reference files. Concise without sacrificing completeness.

DimensionReasoningScore

Conciseness

Lean prose paired with dense executable code; no basic-concept padding and every section advances a concrete evaluation step, so it lands at the 'every token earns its place' anchor rather than the 'could be tightened' level.

3 / 3

Actionability

Provides complete, copy-paste-ready Python (dcg/ndcg/mrr/evaluate, BM25/kNN/RRF retrievers, pytest regression gate) with real Elasticsearch/OpenSearch API calls, plus engine-specific code in verified reference files.

3 / 3

Workflow Clarity

Clear 7-step sequence from judgment set through regression gate, with an explicit CI validation checkpoint (Step 7) and a feedback loop on threshold failure; not capped at 2 because this is measurement work with validation present.

3 / 3

Progressive Disclosure

Core runnable spine stays in SKILL.md while engine-specific weighted-fusion and reranker code is split into two real, well-signaled one-level-deep reference files (judgment-sets.md, weighted-fusion-and-reranking.md), both verified present.

3 / 3

Total

12

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description with concrete actions, an explicit use-when trigger clause, and good natural-keyword coverage in correct third-person voice. It is clearly distinguishable from related retrieval skills.

DimensionReasoningScore

Specificity

Lists multiple concrete actions ('authors ground-truth judgment sets, computes nDCG@k and MRR... measures the lift from Reciprocal Rank Fusion vs weighted fusion vs single-stage retrieval, and quantifies reranker... impact'), matching the multi-action anchor rather than the partial 'names domain and some actions' level.

3 / 3

Completeness

Explicitly answers both 'what' (end-to-end hybrid retrieval evaluation actions) and 'when' via the 'Use when a production system combines lexical and semantic retrieval and you need a numeric relevance baseline, fusion-strategy comparison...' clause; third-person voice throughout.

3 / 3

Trigger Term Quality

Good coverage of natural specialist terms a search engineer would say (hybrid retrieval, BM25, vector, reranker, nDCG@k, MRR, RRF, cross-encoder, Cohere, bge, lexical and semantic retrieval), including common variations.

3 / 3

Distinctiveness Conflict Risk

Clear narrow niche (fused hybrid-retrieval relevance evaluation with specific metrics) and distinct 'Use when' triggers unlikely to collide with sibling BM25-only or vector-recall skills.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents