CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

deepeval-otel

Export raw OpenTelemetry traces from an AI application to Confident AI's Observatory. TRIGGER when the user wants to send OpenTelemetry or OTLP traces/spans from an LLM app, agent, RAG pipeline, or chatbot to Confident AI; configure the Confident AI OTLP endpoint; set confident.span.* or confident.trace.* attributes; export AI-app traces without the deepeval Python package; wire an OTLPSpanExporter, OpenTelemetry Collector, or vendor-neutral OTel SDK to Confident AI; or pick the US vs EU OTLP endpoint. Language-agnostic: the mechanism is OTLP attribute keys plus an exporter endpoint. DO NOT TRIGGER for building DeepEval pytest eval suites, datasets, goldens, metrics, or deepeval test run (use the `deepeval` skill); for instrumenting with the DeepEval SDK's @observe decorator or framework integrations (use the `deepeval-tracing` skill); or for non-AI software such as web servers, CRUD backends, or infrastructure: the confident.* attributes describe AI components only.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A clean, well-disciplined router skill: tight scope boundaries, an explicit decision workflow, and a one-level reference structure with every reference file real and on-topic. The main defects are a dangling reference to the nonexistent 'templates/confident_otel_setup.py' and some cross-section repetition of the HTTP-only and AI-only rules.

Suggestions

Add the missing 'templates/confident_otel_setup.py' (or remove the Templates table and the step-3 pointer) — the body cites it twice but the file does not exist in the bundle.

State the HTTP-only constraint once (e.g., in Prerequisites) and drop the repeats in 'How It Works' and Core Principle 5; likewise compress the AI-only rule, which currently appears in Scope, Core Principle 1, and the description.

Add a short error-recovery hint to workflow step 8 (e.g., common failure causes: wrong region endpoint, gRPC exporter, missing x-confident-api-key header) so the verification step closes the feedback loop.

DimensionReasoningScore

Conciseness

Mostly lean: sections like 'How It Works' and 'Core Principles' are tight and assume OTel competence ('Parent/child nesting comes from native OpenTelemetry span context, not from any attribute'). But a few rules are repeated across sections — the HTTP-only constraint appears in 'Prerequisites', 'How It Works', and Core Principle 5 ('Always use OTLP/HTTP. Confident AI's endpoint does not accept gRPC'), and 'instrument AI components only' is restated in Scope, Core Principle 1, and the description. Anchor 4 ('efficient; minor instances of over-explanation that could be trimmed') fits; not 5 because of this redundancy, not 3 because there is no padding or explanation of concepts Claude already knows.

4 / 5

Actionability

Concrete, executable direction throughout: 'Wire (or repoint) an OTLP/HTTP span exporter with the `x-confident-api-key` header. For Python, start from `templates/confident_otel_setup.py`', 'Choose the endpoint from the API key's region prefix', and specific reference pointers per step. Why not 5: the body defers all concrete detail (endpoint URLs, attribute keys) to references — acceptable for a router skill per the scoring notes — but the referenced template 'templates/confident_otel_setup.py' does not exist in the bundle, leaving step 3 with a dangling pointer and no inline fallback. Why not 3: the guidance that is present is specific and executable, not pseudocode.

4 / 5

Workflow Clarity

An 8-step workflow with clear sequencing, an early applicability gate ('Confirm the target is an AI application ... If it has none of these, stop'), conditional steps, and a terminal verification ('Verify traces appear in the Confident AI Observatory'). Anchor 4 ('clear sequence with most checkpoints present; minor validation gaps') fits: the verification step exists but offers no error-recovery guidance (what to check if traces don't appear), and no debug/troubleshooting feedback loop. Not 3 — the sequence and checkpoints are far more complete than the anchor-3 example; not 5 — no explicit feedback loop. The destructive/batch cap does not apply (read-only export).

4 / 5

Progressive Disclosure

Well-structured overview with a References table and Templates table, one level deep, all four reference files present and containing the promised sections ('Export Only AI Spans' at endpoint-and-exporter.md:130; 'Data-Type Rules' at span-attributes.md:113). Why not 5: scored against the actual bundle, the body points to 'templates/confident_otel_setup.py' twice (workflow step 3 and the Templates table) but no templates/ directory exists — a broken navigation target. Why not 3: the split is otherwise exemplary — overview in SKILL.md, details in single-level references, all real.

4 / 5

Total

16

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: concrete capabilities, explicit positive and negative trigger phrases with named sibling-skill disambiguation, and natural user vocabulary throughout. Its only cost is length, but every clause is a trigger or capability, not padding.

DimensionReasoningScore

Specificity

Quotes multiple concrete actions: 'Export raw OpenTelemetry traces ... to Confident AI's Observatory', 'configure the Confident AI OTLP endpoint', 'set confident.span.* or confident.trace.* attributes', 'wire an OTLPSpanExporter, OpenTelemetry Collector, or vendor-neutral OTel SDK', 'pick the US vs EU OTLP endpoint'. Comprehensive coverage of the skill's capabilities with no generic filler. Anti-drift check: anchor 4 ('several specific actions; minor gaps') is surpassed — every action listed maps to a real capability, so 5 stands.

5 / 5

Completeness

Explicit 'what' ('Export raw OpenTelemetry traces from an AI application to Confident AI's Observatory') followed by an explicit 'when' with concrete trigger phrases ('TRIGGER when the user wants to send ... traces/spans from an LLM app, agent, RAG pipeline, or chatbot to Confident AI') plus negative triggers. Voice is imperative/third-person ('Export', 'TRIGGER'), matching the guideline; no first/second person. Matches the anchor-5 example pattern exactly.

5 / 5

Trigger Term Quality

Covers natural phrasings and synonyms: 'OpenTelemetry or OTLP traces/spans', 'LLM app, agent, RAG pipeline, or chatbot', 'OTLP endpoint', 'US vs EU', 'OpenTelemetry Collector', 'Observatory'. These are the words a user with this need would actually say. Anchor 4 ('a few natural terms missing') is below this level of coverage including abbreviations and vendor-product synonyms.

5 / 5

Distinctiveness Conflict Risk

The 'DO NOT TRIGGER for building DeepEval pytest eval suites, datasets, goldens, metrics, or deepeval test run (use the `deepeval` skill); for instrumenting with the DeepEval SDK's @observe decorator ... (use the `deepeval-tracing` skill)' clause explicitly disambiguates the two most-confusable sibling skills, and the non-AI exclusion carves out the rest. Clear niche with distinct triggers; minimal conflict risk.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

confident-ai/deepeval

Path

skills/deepeval-otel/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.