CtrlK
BlogDocsLog inGet started
Tessl Logo

rag-eval

Filesystem RAG benchmarks: corpus/, train.json, evaluate_rag.py (RAGAS quality). Not for prod monitoring, latency/throughput benchmarking (use rag-perf), or evals outside this repo layout.

67

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, action-oriented skill body with executable commands, a source-of-truth table, and clean one-level-deep reference navigation. The only notable gap is that validation/feedback checkpoints live in references rather than inline in the main workflow.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence (no explanation of what RAG/RAGAS are), with lean tables and terse gotchas; minor repetition of the run command and credential-hygiene pointers keeps it just below a 5.

4 / 5

Actionability

Provides copy-paste-ready executable commands (uv run --project scripts/eval python scripts/eval/evaluate_rag.py ...), concrete JSON pretty-printing, and specific flag names covering the common cases.

5 / 5

Workflow Clarity

Two clear numbered sequences (Instructions, Agent playbook) with explicit prerequisites and a troubleshooting/error table, but validation checkpoints are largely deferred to references rather than embedded inline, so it falls just short of explicit validate->fix->retry loops.

4 / 5

Progressive Disclosure

Clear overview body pointing to four real one-level-deep reference files (benchmark-execution.md, dataset-and-conversion.md, evaluate-rag-cli.md, result-analysis.md) with well-signaled links and section anchors; bulk procedural detail is appropriately offloaded.

5 / 5

Total

18

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A tightly written, highly specific description that names concrete artifacts and carves out a clear niche with explicit disambiguation against sibling skills. The main gap is an explicit positive 'Use when...' trigger clause, which is conveyed only through negative boundaries.

Suggestions

Add an explicit positive trigger clause (e.g., 'Use when running RAGAS quality evaluations over a corpus/ + train.json dataset layout') so the 'when' is stated affirmatively, not only via exclusions.

Include a few more user-natural synonyms or file extensions (e.g., '.json', 'evaluation_data') to broaden trigger_term_quality coverage.

DimensionReasoningScore

Specificity

Names concrete artifacts ('corpus/', 'train.json', 'evaluate_rag.py') and a specific quality framework (RAGAS), giving comprehensive concrete actions for the domain rather than generic language.

5 / 5

Completeness

Clearly states what the skill does (filesystem RAG benchmarks with RAGAS quality) and provides explicit 'when not to use' exclusion guidance, but the positive 'Use when...' trigger is implied via the negative boundaries rather than stated as a concrete trigger phrase.

4 / 5

Trigger Term Quality

Strong natural terms ('RAG benchmarks', 'RAGAS quality', 'latency/throughput benchmarking', 'prod monitoring') with good synonyms, but lacks file extensions or broader user phrasings beyond the niche vocabulary.

4 / 5

Distinctiveness Conflict Risk

A clear niche (filesystem RAG quality evals with this exact layout) is sharply separated from rag-perf and rag-blueprint via explicit 'not for' routing, minimizing wrong-skill triggering.

5 / 5

Total

18

/

20

Passed

Validation

68%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation11 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 15 missing, 8 deeper-than-1-level

Warning

Total

11

/

16

Passed

Repository
NVIDIA/skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.