CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/ragas-evaluation

Authors and runs Ragas - RAG-pipeline evaluation framework with metrics organized into RAG (Faithfulness, Response Relevancy, Context Precision/Recall, Context Entities Recall, Noise Sensitivity), Natural Language Comparison (Factual Correctness, Semantic Similarity, BLEU/ROUGE/CHRF/Exact Match), Agents/Tool-Use (Topic Adherence, Tool Call Accuracy/F1, Agent Goal Accuracy), General Purpose (Aspect Critic, Rubrics-based Scoring), Nvidia (Answer Accuracy, Context Relevance, Response Groundedness), and Summarization. Use when the user evaluates a RAG pipeline (retriever + generator) and needs the deepest metric variety in the OSS LLM-eval space.

80

Quality

100%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is well-crafted: concise and assumption-respecting, with executable code at every decision point, a clear sequenced workflow, and clean progressive disclosure to a verified one-level-deep reference. Time-sensitive concerns are correctly deferred to canonical docs.

DimensionReasoningScore

Conciseness

The body is lean and assumes Claude's competence — no RAG/library tutorials, no padding — and handles time-sensitive API drift by deferring to the canonical doc rather than restating signatures, matching the score-3 anchor.

3 / 3

Actionability

It provides executable pip commands, a complete copy-paste-ready DiscreteMetric quickstart, a CI snippet with concrete threshold assertions, and an anti-pattern table with fixes, matching the fully-executable score-3 anchor.

3 / 3

Workflow Clarity

Steps 1–6 are clearly sequenced (install → quickstart → pick metrics → dataset shape → integration → CI), with the CI assertions serving as an explicit verification checkpoint; this is evaluation rather than destructive/batch work, so no mid-flow validation cap applies.

3 / 3

Progressive Disclosure

SKILL.md is an overview that offloads the full metric catalog to a clearly signaled, one-level-deep references/metrics.md (verified present on disk), with external doc links organized in a References section, matching the score-3 anchor.

3 / 3

Total

12

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong: it states concrete actions, provides a natural explicit 'Use when' trigger, covers relevant natural terms, and carves out a distinct RAG-eval niche in third-person voice. The enumerated metric list earns its place as the core differentiator rather than padding.

DimensionReasoningScore

Specificity

'Authors and runs Ragas' plus an enumerated taxonomy of metric families (Faithfulness, Context Precision/Recall, Tool Call F1, Aspect Critic) lists multiple concrete actions, matching the score-3 anchor and exceeding the domain-only score-2 anchor.

3 / 3

Completeness

It explicitly answers both what ('authors and runs Ragas … with metrics organized into …') and when via an explicit 'Use when the user evaluates a RAG pipeline …' clause, satisfying the score-3 anchor.

3 / 3

Trigger Term Quality

Natural trigger terms a RAG-eval user would say are present — 'evaluates a RAG pipeline (retriever + generator)', 'LLM-eval', 'metric variety' — giving good coverage rather than a single keyword.

3 / 3

Distinctiveness Conflict Risk

Scoped to RAG pipelines and positioned as 'deepest metric variety in the OSS LLM-eval space', with correct third-person voice, giving it a clear niche unlikely to trigger for the wrong skill.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents