CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/elasticsearch-relevance-tests

Use before changing analyzers, synonyms, boosts or query templates on Elasticsearch, OpenSearch or Solr search, so a relevance baseline exists. Builds judgment lists and _rank_eval tests with precision, recall, MRR and DCG, plus OpenSearch and Solr specifics in its references.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered skill body: a tight five-step workflow with executable code and assert checkpoints, honest limitations and anti-patterns, and exemplary progressive disclosure that routes per-engine deltas to real, clearly scoped reference files. The few weaknesses are small — repeated citation padding, a Step 5 snippet with an undefined helper, and no guidance for recovering from a detected regression.

DimensionReasoningScore

Conciseness

The body is dense and table-driven with no explanations of concepts Claude already knows (no "what is Elasticsearch" padding), and the anti-patterns/limitations tables earn their tokens. Not 5 because the opening epigraph quote ("evaluates search result quality across typical queries") and the three repeated "Per the [Elasticsearch Rank Eval API]" attributions are minor padding that could be trimmed.

4 / 5

Actionability

The full _rank_eval request JSON, response shape, CSV judgment format, and Step 4 pytest wrapper are concrete and executable. Not 5 because Step 5's snippet calls an undefined run_rank_eval() and omits the json/Path imports, so it is not copy-paste ready as written.

4 / 5

Workflow Clarity

Steps 1–5 are explicitly sequenced (build judgment list, define metrics, submit request, wrap as test, per-query regression) with assert-based validation checkpoints embedded in the test code. Not 5 because there is no explicit error-recovery guidance once a regression is detected (what to inspect, fix, and re-run), leaving a minor feedback-loop gap.

4 / 5

Progressive Disclosure

The engine-routing table, the Advanced topics section, and the References section each signal exactly which of the three real one-level-deep reference files (references/opensearch.md, references/solr.md, references/rank-eval-guide.md) holds which content, and all referenced files exist with clear scope statements. This matches the clear-overview-with-well-signaled-references anchor.

5 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit use-trigger tied to concrete change events (analyzers, synonyms, boosts, query templates), a clear capability statement, and a well-delineated niche across three named search engines. Third-person voice is correct and there is no fluff. Minor room to name the regression-gate outcome and a few more natural synonyms like "search quality" or "NDCG".

DimensionReasoningScore

Specificity

"Builds judgment lists and _rank_eval tests with precision, recall, MRR and DCG" plus "Use before changing analyzers, synonyms, boosts or query templates" names several concrete actions. Not 5 because the regression-gating and per-query regression detection halves of the skill are not mentioned, leaving minor coverage gaps.

4 / 5

Completeness

Both questions are explicitly answered with concrete trigger phrases: "Use before changing analyzers, synonyms, boosts or query templates ... so a relevance baseline exists" gives the when, and "Builds judgment lists and _rank_eval tests with precision, recall, MRR and DCG" gives the what. It clearly matches the 5 anchor rather than 4, where the when would be less explicit.

5 / 5

Trigger Term Quality

Natural domain terms are well covered: "analyzers", "synonyms", "boosts", "query templates", "relevance baseline", "Elasticsearch", "OpenSearch", "Solr", "search". Not 5 because common user phrasings like "search quality", "ranking", or "NDCG" are absent.

4 / 5

Distinctiveness Conflict Risk

A clear niche — term-engine relevance testing on Elasticsearch, OpenSearch, and Solr — with engine names and metric-specific triggers that few other skills would claim. The only conceivable overlap (a vector-recall skill) is not hinted at here, keeping conflict risk minimal.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page