CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/langfuse-tracing

Wires Langfuse tracing into LLM apps for production observability, monitoring, telemetry, and offline eval - instruments via `@observe` (Python) / `startActiveObservation` (TS) decorators that auto-capture inputs / outputs / timings / errors per generation; exposes `langfuse.update_current_span()` for metadata + cost / latency annotation; supports trace-bound scoring for eval datasets and prompt-as-code management. Use when the user needs to monitor, log, trace, or debug LLM API calls in production beyond pre-deploy eval, wants to add LLM observability tooling to an existing app, or wants to ship traces from production to an eval dataset for offline regression testing.

72

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable skill body with executable code in every step, explicit validation feedback loops, and clean one-level-deep progressive disclosure into two real reference files. The only notable weakness is mild verbosity — some UI-feature prose and a duplicated framing sentence that could be trimmed.

Suggestions

Remove the duplicated "Langfuse is observability-side, not pre-deploy CI-side" sentence from Step 7 since it opens references/ci-integration.md verbatim; replace with a one-line pointer.

Trim UI-feature narration ("Version history and A/B comparison are available in the UI") to keep the body focused on wiring actions Claude must perform.

DimensionReasoningScore

Conciseness

Mostly action-dense and avoids explaining known concepts, but UI-feature prose ("Version history and A/B comparison are available in the UI") and the duplicated "Langfuse is observability-side, not pre-deploy CI-side" (Step 7 and references/ci-integration.md) could be tightened. Matches anchor 2; not 3 because of that slack, not 1 because it assumes Claude's competence and omits concept primers.

2 / 3

Actionability

Fully executable, copy-paste-ready code throughout: `pip install langfuse`, the `@observe(name=..., as_type="generation")` decorator, a complete `startActiveObservation` try/finally block, `langfuse.score(trace_id=..., name=..., value=...)`, the dataset `item.run()` loop, and `get_prompt(...).compile(...)`. Matches anchor 3; not 2 because the code is real and complete rather than pseudocode.

3 / 3

Workflow Clarity

Seven sequenced steps with explicit validation checkpoints and error-recovery feedback loops, e.g. "If no trace appears within ~30 s: Confirm `LANGFUSE_PUBLIC_KEY`... Call `await langfuse.flushAsync()`... Check `langfuse.debug()` output". Matches anchor 3; not 2 because checkpoints are explicit, not implicit.

3 / 3

Progressive Disclosure

The overview body points to two verified one-level-deep references, clearly signaled ("See references/datasets.md for building datasets from production traces, the [lf-ds] API signature, and the run-validation checkpoint"); neither reference nests further. Matches anchor 3; not 2 because content is appropriately split and navigation is clear.

3 / 3

Total

11

/

12

Passed

Description

92%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, highly specific description with concrete actions and natural trigger terms that clearly cover both what the skill does and when to use it. The main weakness is overlap with pre-deploy eval skills via its offline-eval/eval-dataset phrasing, which is only partially disambiguated by the "beyond pre-deploy eval" carve-out.

Suggestions

Sharpen the distinction from pre-deploy eval skills by leading the when-clause with production/post-deploy framing (e.g. "Use for post-deploy observability of live LLM calls") before mentioning offline eval, so the offline-eval mention reads as a consequence rather than a primary trigger.

Tighten "prompt-as-code management" and "trace-bound scoring" into more user-natural phrasings or drop them from the description if they are covered in the body, reducing jargon load.

DimensionReasoningScore

Specificity

Lists multiple concrete actions: "instruments via `@observe` (Python) / `startActiveObservation` (TS) decorators that auto-capture inputs / outputs / timings / errors", "exposes `langfuse.update_current_span()` for metadata + cost / latency annotation", and "supports trace-bound scoring... and prompt-as-code management". Matches the anchor for multiple specific concrete actions; not 2 because it enumerates several distinct actions rather than naming only a domain and a few.

3 / 3

Completeness

Explicitly answers both what ("Wires Langfuse tracing into LLM apps for production observability, monitoring, telemetry, and offline eval") and when ("Use when the user needs to monitor, log, trace, or debug LLM API calls in production..."). Both halves are explicit; not 2 because the when is stated, not merely implied.

3 / 3

Trigger Term Quality

The trigger clause gives natural phrasings users would say: "monitor, log, trace, or debug LLM API calls in production" and "add LLM observability tooling to an existing app". Good coverage of natural terms; not 2 because common variations (monitor/log/trace/debug) are present rather than only jargon.

3 / 3

Distinctiveness Conflict Risk

It has a clear Langfuse-specific niche, but "offline eval", "eval datasets", and "offline regression testing" language overlaps with pre-deploy eval skills (the body itself names deepeval/ragas/promptfoo sisters). Matches anchor 2 (somewhat specific but could overlap with similar skills); not 3 because of that genuine overlap, not 1 because the Langfuse/production-observability triggers are distinctive.

2 / 3

Total

11

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents