CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/opensearch-relevance-tests

Author OpenSearch relevance tests with Search Relevance Workbench (judgment lists, query sets, experiments), `_rank_eval` API (Elasticsearch-fork-compatible), and hybrid BM25 + neural ranking eval. Reuse Elasticsearch judgment list format; document the differences (neural search query DSL, hybrid weighting via `neural_query_enricher`). Use when an OpenSearch index turns on neural or hybrid search, or when a move off Elasticsearch has to prove relevance parity between the two clusters.

79

Quality

99%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A tight, action-oriented skill body: every step ships executable code and an explicit assertion that validates the outcome, organized into clean sections with shallow external references. It reads as overview-plus-working-snippets rather than a monolithic wall of text.

DimensionReasoningScore

Conciseness

Lean body that assumes Claude's competence — no 'what is OpenSearch' preamble, just code blocks, tables, and tight prose where each sentence earns its place, matching the 'lean and efficient' anchor over the 'could be tightened' level 2.

3 / 3

Actionability

Fully executable, copy-paste-ready examples throughout: `_rank_eval` and hybrid search HTTP requests, k-NN index mappings, search-pipeline config, and Python test functions, satisfying the 'fully executable code/commands' anchor.

3 / 3

Workflow Clarity

Seven clearly sequenced steps each carrying explicit assert-based validation (recall≥0.85, delta≥−0.10, ES/OS delta<0.05) with an anti-patterns table mapping failures to fixes, meeting the 'clear sequence with explicit validation steps' anchor.

3 / 3

Progressive Disclosure

A single well-sectioned SKILL.md with only one-level-deep external references (the OpenSearch docs link and named sibling skills) and no nested/deep references; no bundle files exist, so the inline code is appropriately organized rather than mis-split.

3 / 3

Total

12

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A precise, third-person description that states concrete capabilities and an explicit 'Use when' trigger, scoped to a distinct OpenSearch relevance-testing niche. It earns top marks on all four dimensions with no padding or over-claims.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Author OpenSearch relevance tests with Search Relevance Workbench (judgment lists, query sets, experiments)', '`_rank_eval` API', and 'hybrid BM25 + neural ranking eval' — matching the 'lists multiple specific concrete actions' anchor rather than the partial level 2.

3 / 3

Completeness

Answers both what ('Author OpenSearch relevance tests with…') and when via an explicit 'Use when an OpenSearch index turns on neural or hybrid search, or when a move off Elasticsearch has to prove relevance parity' clause, not the implied-only level 2.

3 / 3

Trigger Term Quality

Natural terms a user would say are well covered ('OpenSearch relevance tests', 'neural search', 'hybrid search', 'relevance parity', 'move off Elasticsearch') in third-person voice, above the 'some relevant keywords' level 2.

3 / 3

Distinctiveness Conflict Risk

A clear OpenSearch-specific niche (neural/hybrid eval plus ES→OS migration parity) that distinguishes it from the generic and elasticsearch sister skills, unlikely to trigger for the wrong skill.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents