CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/deepeval-evaluation

Use for any question or task about testing an LLM or RAG app with pytest, including hallucination checks in CI and answers that invent facts missing from the retrieved documents: DeepEval LLMTestCase, built-in metrics such as G-Eval, answer relevancy, faithfulness, contextual recall and precision, hallucination, bias and toxicity, deepeval test run with assert_test, and the Confident AI dashboard.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a highly actionable, well-sequenced guide with copy-paste-ready code at every step and a useful anti-patterns table. Its main inefficiency is the repetitively attributed source citations, and its workflows lack explicit error-recovery loops for CI failures.

DimensionReasoningScore

Conciseness

Tables and steps are lean and assume Claude's competence (no explanation of pytest or RAG basics), but the "Per [de-gh][de-gh]" attribution is repeated roughly seven times, including a standalone "(Per [de-gh][de-gh].)" line, which is trimming-able padding.

4 / 5

Actionability

Fully executable throughout: "pip install -U deepeval", the verbatim quickstart test with LLMTestCase/GEval/assert_test, "deepeval test run test_chatbot.py", a copy-paste custom GEval example, an evaluate() batch example, and a CI command with --run-async --workers 4 covering the common cases.

5 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced (install, first test, test-case fields, metric catalog, custom GEval, batch evaluation, CI) with an explicit exit-code checkpoint ("pytest exit code propagates: nonzero if any assert_test fails") and an anti-patterns table of fixes, but there is no error-recovery feedback loop (e.g., what to do when a judge metric errors or a threshold fails in CI).

4 / 5

Progressive Disclosure

A well-organized single-file skill with clear section headers, flat one-level references, and no nested reference chains; at ~185 lines it exceeds the simple-skill exception, and the metric catalog or CI detail could arguably live in a separate reference file.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly states both what the skill covers (a comprehensive, concrete list of DeepEval's test-case API, metrics, runner, and dashboard) and when to use it, in natural user language. The only weakness is modest synonym coverage for evaluation-related trigger phrases.

DimensionReasoningScore

Specificity

Enumerates concrete capabilities: "DeepEval LLMTestCase, built-in metrics such as G-Eval, answer relevancy, faithfulness, contextual recall and precision, hallucination, bias and toxicity, deepeval test run with assert_test, and the Confident AI dashboard" — a comprehensive inventory of the library's surface with no significant gaps, matching the 'comprehensive coverage' anchor.

5 / 5

Completeness

Explicitly answers 'when' with concrete triggers ("Use for any question or task about testing an LLM or RAG app with pytest, including hallucination checks in CI...") and 'what' via the detailed tool and metric enumeration.

5 / 5

Trigger Term Quality

Natural user phrasings like "testing an LLM or RAG app with pytest", "hallucination checks in CI", and "answers that invent facts missing from the retrieved documents" are present, but common variations such as "LLM evaluation", "evals", or "LLM-as-judge" are missing.

4 / 5

Distinctiveness Conflict Risk

Clear niche of pytest-based LLM evaluation anchored by named, distinctive triggers (DeepEval, assert_test, Confident AI dashboard); only minor overlap risk with closely related RAG-eval sister skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page