CtrlK
BlogDocsLog inGet started
Tessl Logo

deepeval

DeepEval evaluation workflow for AI agents and LLM applications. TRIGGER when the user wants to evaluate or improve an AI agent, tool-using workflow, multi-turn chatbot, RAG pipeline, or LLM app; add evals; generate datasets or goldens; use deepeval generate; use deepeval test run; send results to Confident AI; monitor production; run online evals; inspect traces; or iterate on prompts, tools, retrieval, or agent behavior from eval failures. AI agents are the primary use case. Covers Python SDK, pytest eval suites, CLI generation, traced evals, Confident AI reporting, and agent-driven improvement loops. DO NOT TRIGGER for unrelated generic pytest, non-AI test setup, or non-DeepEval observability work unless the user asks to compare or migrate to DeepEval; for instrumenting an app with DeepEval tracing, @observe, or framework integrations (use the `deepeval-tracing` skill); or for raw OpenTelemetry / OTLP export without the deepeval package (use the `deepeval-otel` skill).

67

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./docs/public/.well-known/agent-skills/deepeval/SKILL.md

The canonical home for this skill is deepeval in confident-ai/deepeval

SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, actionable eval workflow with real commands and clear sequencing, but it is longer than necessary due to repetition between the Workflow Summary, Core Principles, and Required Workflow, and it references template files that are not present in the bundle.

Suggestions

Add the missing templates/ files (test_single_turn_tracing.py, test_single_turn_no_tracing.py, test_multi_turn_e2e.py, metrics.py) so every path the workflow references resolves.

Collapse the duplicate handoff language (deepeval-tracing / deepeval-otel split, tracing recommendation) into Core Principles and reference it once from the Required Workflow instead of restating it.

Add an explicit validation checkpoint in step 7 (e.g. confirm the suite passes before advancing rounds, and what to do on persistent failures) to strengthen the iteration feedback loop.

DimensionReasoningScore

Conciseness

The body is mostly efficient and assumes Claude's competence, but it repeats the same points across sections (e.g. tracing-handoff and the deepeval-tracing/otel split appear in both Core Principles and Required Workflow) and the Required Workflow restates Workflow Summary steps, adding notable length without proportional new information.

3 / 5

Actionability

Concrete, copy-pasteable commands are provided (e.g. the `deepeval generate` and `deepeval test run` blocks with real flags), plus specific API calls like `assert_test(golden=golden, metrics=[...])` and `dataset.evals_iterator(metrics=[...])`; the main gap is the four referenced `templates/*.py` files do not exist in the bundle.

4 / 5

Workflow Clarity

The Required Workflow is a clearly sequenced seven-step process with explicit branching (precedence rules, intake questions, template selection) and an iteration loop, plus run flags and per-step reference pointers; it lacks an explicit validate-the-output checkpoint before iterating, though iteration-on-failures partially serves that role.

4 / 5

Progressive Disclosure

The overview is well-organized with a References table and a Templates table pointing to one-level-deep reference files, but four referenced templates (test_single_turn_tracing.py, test_single_turn_no_tracing.py, test_multi_turn_e2e.py, metrics.py) are missing from the bundle, breaking navigation for the template paths the workflow depends on.

3 / 5

Total

14

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is a strong, specific description with comprehensive trigger terms and an explicit what/when structure, including a DO NOT TRIGGER boundary that routes overlapping work to sibling skills. The only minor gap is residual overlap risk across the broad AI-agent/LLM-app surface, which it largely mitigates via explicit handoffs.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "add evals; generate datasets or goldens; use deepeval generate; use deepeval test run; send results to Confident AI; monitor production; run online evals; inspect traces; or iterate on prompts, tools, retrieval, or agent behavior" — covering the SDK, pytest suites, CLI, tracing, and reporting comprehensively.

5 / 5

Completeness

Explicitly answers both what (end-to-end DeepEval eval workflow covering SDK, pytest suites, CLI generation, traced evals, Confident AI reporting, improvement loops) and when (a detailed TRIGGER clause enumerating scenarios), plus an explicit DO NOT TRIGGER clause for exclusions.

5 / 5

Trigger Term Quality

Comprehensive natural trigger terms including synonyms and specific phrases users say: "evaluate or improve an AI agent", "add evals", "generate datasets", "RAG pipeline", "chatbot", "deepeval generate", "deepeval test run", "Confident AI", "inspect traces", with a clear TRIGGER marker.

5 / 5

Distinctiveness Conflict Risk

It carves out a clear niche (deepeval package evals) and explicitly routes adjacent work to sibling skills (deepeval-tracing, deepeval-otel) to reduce conflicts, but the broad "AI agent / LLM app / RAG" surface still has minor overlap risk with adjacent eval/observability skills.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
confident-ai/deepeval
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.