CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

deepeval-tracing

Instrument an AI application with DeepEval's native tracing so its behavior is visible in Confident AI. TRIGGER when the user wants to add DeepEval tracing or @observe to an LLM app, agent, RAG pipeline, or chatbot; wire a framework, model-provider, or vector-database integration (LangGraph, LangChain, OpenAI Agents, LlamaIndex, Pydantic AI, CrewAI, and others); choose between a native integration and manual instrumentation; set span types, tags, or metadata; or send DeepEval-SDK traces to Confident AI's Observatory. DO NOT TRIGGER for building DeepEval pytest eval suites, datasets, goldens, metrics, or deepeval test run (use the `deepeval` skill), or for raw OpenTelemetry / OTLP export without the deepeval package (use the `deepeval-otel` skill). This skill is purely DeepEval-SDK instrumentation — producing well-formed traces, not running evals.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured routing skill: a lean overview with a clear workflow, explicit scope boundaries, and verified one-level-deep references. Its main weaknesses are redundant restatement across the Scope, Workflow, and Core Principles sections, and the absence of any inline '@observe' example or troubleshooting step for the final trace-verification.

Suggestions

Merge the 'Core Principles' section into the Workflow (or trim it to principles not already stated as steps) — three of its six points duplicate step 3, step 6, and the Scope section verbatim in substance.

Add a minimal two-to-three-line inline example of '@observe' decorating a function (import, decorator, span type) so the core mechanism is visible before jumping to references/tracing.md.

Add an error-recovery branch to step 7: if traces do not appear in the Observatory, re-check 'deepeval login' / CONFIDENT_API_KEY and the span type values before instrumenting further.

DimensionReasoningScore

Conciseness

The body is lean and assumes Claude's competence — no re-teaching of tracing or LLM concepts — but there is noticeable structural redundancy: the 'Core Principles' section restates the Workflow ('never trace secrets', 'prefer a supported integration', 'read the exact integration doc' each appear twice) and the sibling-skill section repeats the frontmatter's disambiguation. This sits above the mostly-efficient-but-could-be-tightened anchor (3) but short of the every-token-earns-its-place anchor (5).

4 / 5

Actionability

The guidance is concrete and executable for an instruction-only skill: exact file pointers ('Read references/integrations.md', 'Read references/tracing.md'), real commands ('pip install deepeval', 'deepeval login', 'CONFIDENT_API_KEY'), and enumerated span types. It falls short of fully copy-paste-ready (5) because no minimal inline example of '@observe' usage appears — even a two-line snippet — leaving the first concrete code encounter deferred to a reference file.

4 / 5

Workflow Clarity

The 7-step workflow is clearly sequenced with an explicit stop-gate in step 1 and a verification checkpoint in step 7 ('verify traces appear in the Confident AI Observatory'). It misses the level 5 anchor because there is no error-recovery loop for the verification step — no guidance on what to check if traces do not appear (e.g., re-check login/API key).

4 / 5

Progressive Disclosure

The SKILL.md body is a genuine overview that routes to two real, one-level-deep reference files (both verified to exist with substantive content, no nested chains), signaled both inline in the workflow steps and in a clean topic-to-file table under 'References'. This matches the clear-overview-with-well-signaled-references anchor.

5 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: it states concrete capabilities in third-person voice, gives explicit TRIGGER conditions with natural keywords and named frameworks, and disambiguates the two adjacent skills with explicit DO-NOT-TRIGGER routing. Dense but with no fluff — every clause is a trigger or a disambiguation signal.

DimensionReasoningScore

Specificity

The description lists multiple concrete, comprehensive actions in third-person imperative form: 'Instrument an AI application with DeepEval's native tracing', 'wire a framework, model-provider, or vector-database integration (LangGraph, LangChain, OpenAI Agents, LlamaIndex, Pydantic AI, CrewAI...)', 'set span types, tags, or metadata', and 'send DeepEval-SDK traces to Confident AI's Observatory'. This matches the anchor for multiple specific concrete actions with comprehensive coverage, not the level 4 anchor which expects minor gaps in coverage.

5 / 5

Completeness

It explicitly answers both questions: the opening sentence states what the skill does ('Instrument an AI application with DeepEval's native tracing so its behavior is visible in Confident AI') and 'TRIGGER when...' gives concrete when-to-use phrases. Not level 4, because the 'when' is fully explicit with multiple concrete trigger scenarios rather than only 'could be more specific'.

5 / 5

Trigger Term Quality

Natural trigger terms and synonyms are comprehensively covered: 'DeepEval tracing', '@observe', 'LLM app, agent, RAG pipeline, or chatbot', six named frameworks, 'span types, tags, or metadata', 'OpenTelemetry / OTLP export', and 'deepeval test run'. A user phrasing a request in any of these ways would naturally land on this skill, matching the comprehensive-synonyms anchor.

5 / 5

Distinctiveness Conflict Risk

It carves out a clear niche and actively prevents mis-triggering with explicit 'DO NOT TRIGGER for building DeepEval pytest eval suites... (use the `deepeval` skill), or for raw OpenTelemetry / OTLP export... (use the `deepeval-otel` skill)' clauses. Minimal conflict risk, matching the clear-niche anchor.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

confident-ai/deepeval

Path

skills/deepeval-tracing/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.