CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/deepeval-evaluation

Use when LLM or RAG evaluation should run as pytest tests: DeepEval LLMTestCase, built-in metrics such as G-Eval, answer relevancy, faithfulness, contextual recall and precision, hallucination, bias and toxicity, deepeval test run with assert_test, and the Confident AI dashboard.

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-crafted, action-first body: copy-paste-ready code for every phase, a sequenced 7-step workflow with pass/fail semantics, and high-value Anti-patterns and Limitations sections that demonstrate genuine expertise. It earns 5 on actionability and a solid 4 elsewhere, with only minor trims (citation filler) and a missing metric-failure debugging loop keeping it from top marks.

Suggestions

Trim the repeated 'Per [de-gh][de-gh]' attributions to a single source note or the References section to save tokens.

Add a short feedback loop for failed metrics (e.g., what to inspect when a judge score is borderline — criteria wording, threshold tuning, judge-model pinning).

If the skill grows, move the metric catalog table to references/metrics.md and keep a 3-4 line decision summary inline.

DimensionReasoningScore

Conciseness

The body is efficient — lean tables, copy-paste code, no explanations of basics Claude already knows — but repeated 'Per [de-gh][de-gh]' attribution lines, the Overview doc-quote, and the filler '(Per [de-gh][de-gh].)' line after the run command are trimmable, matching anchor 4 rather than the every-token-earns-its-place anchor 5.

4 / 5

Actionability

Fully executable throughout: 'pip install -U deepeval', 'deepeval login', a complete verbatim quickstart (imports, GEval with criteria/params/threshold, LLMTestCase with populated fields, assert_test), a run command, a full custom-GEval snippet, and a CI command with flags. Only Step 6's evaluate() call uses illustrative placeholders, comparable to the illustrative line in the anchor-5 example, so this is not the minor-gaps state of anchor 4.

5 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced (install → first test → fields → metrics → custom → batch → CI) with validation signals ('pytest exit code propagates: nonzero if any assert_test fails', the score ≥ threshold pass rule, and an Anti-patterns table with fixes). It lacks an explicit error-recovery loop for failed metrics, so it fits anchor 4 rather than the feedback-loop-complete anchor 5; the batch-operation cap does not apply since assert_test plus exit-code propagation is built-in validation.

4 / 5

Progressive Disclosure

No bundle files exist, and the single-file structure is well-organized with clear section headers, tables, and one-level-deep references (external URLs and sister skills) with no nesting. The ~180-line body inlines the metric catalog — reasonable as a decision guide, but it could split into a references file as the skill grows, matching anchor 4's 'minor organization gaps' rather than the fully-split anchor 5.

4 / 5

Total

17

/

20

Passed

Description

75%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit Use-when clause, third-person voice, and a specific enumeration of DeepEval's components and metrics. It scores uniformly 4: comprehensive and distinctive but built from a noun list rather than concrete actions, with a single trigger condition and a few missing natural synonyms.

Suggestions

Lead with 2-3 concrete action verbs (e.g., 'Write LLM/RAG evaluations as pytest tests using DeepEval metrics, assert results with assert_test, and track regressions...') so capabilities read as actions rather than a component noun list.

Add trigger variations to the when-clause, e.g. 'Use when the user asks to evaluate an LLM or RAG application, add eval tests, measure faithfulness or hallucination, or set up LLM-as-judge scoring.'

Sharpen distinctiveness from sister skills by naming the pytest-native angle early, e.g. 'unlike YAML-config tools (promptfoo) or library-only RAG metrics (ragas), evaluations run as standard pytest tests.'

DimensionReasoningScore

Specificity

Lists ~10 concrete named components ("LLMTestCase", "G-Eval", "answer relevancy, faithfulness, contextual recall and precision, hallucination, bias and toxicity", "assert_test", "Confident AI dashboard") but presents them as a noun catalog with minor gaps (no batch evaluate or custom-criteria mention), matching anchor 4 rather than the comprehensive action-verb coverage of anchor 5.

4 / 5

Completeness

Explicitly answers both: "Use when LLM or RAG evaluation should run as pytest tests" (when) plus a detailed capability list (what). The when-clause is a single condition without additional concrete trigger phrases, so it sits at anchor 4 rather than the multi-trigger anchor 5 and well above the when-missing anchor 3.

4 / 5

Trigger Term Quality

Natural phrases like "LLM or RAG evaluation", "pytest tests", "faithfulness", "hallucination", and "Confident AI dashboard" give good keyword coverage, but common variations such as "LLM-as-judge", "benchmark", or "eval framework" are missing, fitting anchor 4 rather than the synonym-complete anchor 5.

4 / 5

Distinctiveness Conflict Risk

DeepEval, pytest integration, and Confident AI pin a clear niche with distinct triggers, but the generic opening "LLM or RAG evaluation" overlaps the domain of closely related sister skills (ragas-evaluation, promptfoo-evaluation), placing it between the minor-overlap anchor 4 and the minimal-conflict anchor 5.

4 / 5

Total

16

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page