CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/ragas-evaluation

Use for any question or task about RAG or agent evaluation metrics, including which metrics to use, scoring an answer against its contexts, and telling retrieval problems from generation problems after a change such as chunk size: Ragas faithfulness, response relevancy, context precision and recall, noise sensitivity, factual correctness, tool-call accuracy, agent goal accuracy and rubric scoring.

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-crafted skill body: executable code for every workflow stage, explicit validation and baseline discipline, and proper delegation of the bulk metric catalog to a single clearly-signaled reference file. The only weakness is minor repetition across sections that could be tightened.

DimensionReasoningScore

Conciseness

The body is dense and assumes competence — no concept explanations, tables for datasets and anti-patterns, executable code throughout. A few points are repeated (pinning guidance appears in both Anti-patterns and Limitations, "the canonical doc is the source of truth" appears twice, and the References section re-lists links already defined inline), so it is not perfectly lean.

4 / 5

Actionability

Fully executable, copy-paste-ready guidance throughout: install commands, a complete DiscreteMetric custom-metric example, an EvaluationDataset example, a runnable ToolCallAccuracy/AgentGoalAccuracy script with asserts, and a CI script with a pinned judge, baseline comparison, and tolerance checks covering the common cases.

5 / 5

Workflow Clarity

Steps 1–6 (plus 5a/5b) are clearly sequenced with explicit validation checkpoints: assert statements on scores and judge identity, a "judge changed: re-baseline first" guard, gating guidance ("require 1.0" on critical tool calls), and feedback loops for regression handling in CI.

5 / 5

Progressive Disclosure

Clear overview with a single well-signaled, one-level-deep reference: the 30+ metric catalog is properly split into references/metrics.md (verified to exist and match its stated purpose), linked with intent in Step 3, while the body keeps only the curated mainstream patterns.

5 / 5

Total

19

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit 'Use for...' trigger clause, concrete capabilities, and a comprehensive named-metric list covering both RAG and agent evaluation. Trigger-term coverage and distinctiveness from sister evaluation skills are the only minor gaps.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — "which metrics to use", "scoring an answer against its contexts", "telling retrieval problems from generation problems" — plus a comprehensive named-metric list spanning RAG (faithfulness, context precision and recall, noise sensitivity) and agent evaluation (tool-call accuracy, agent goal accuracy, rubric scoring).

5 / 5

Completeness

It explicitly answers both: an explicit trigger clause ("Use for any question or task about RAG or agent evaluation metrics", including the concrete scenario "after a change such as chunk size") and a clear statement of what it does via the named metric capabilities.

5 / 5

Trigger Term Quality

Natural phrases users would say are present ("RAG or agent evaluation metrics", "Ragas faithfulness", "context precision and recall"), but a few common variants like "groundedness", "retrieval quality", or generic "LLM eval" are missing. It is clearly above "some relevant keywords" but short of comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

It is anchored to the Ragas niche with RAG-specific metric names, minimizing wrong-skill triggers, but generic phrases like "agent evaluation metrics" and "rubric scoring" create minor overlap risk with closely related eval skills (e.g., deepeval, promptfoo).

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page