CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

maple-agent-tracing-llamaindex

Trace LlamaIndex agents with Maple: OpenInference LlamaIndex instrumentor with GenAI output, a conversation id per chat, agent names and one span per model call, so each conversation is one Maple Agent Session with transcript, tools and tokens. Triggers on 'trace my llamaindex agent', 'add Maple to llamaindex', 'agent sessions for llamaindex', 'OpenTelemetry for llamaindex', 'llama-index observability'.

76

Quality

95%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally actionable, well-sequenced integration runbook: complete verbatim code, exact commands, conflict detection, and a thorough verification checklist with fallbacks. Its only weaknesses are inline time-sensitive version details and an edge-case section that could be offloaded to a reference file.

Suggestions

Move the Edge cases tail (native llama-index-observability-otel details, span-layout quirks, OpenRouter Broadcast, the streaming-query-engine PR #3841 pin) into a references/edge-cases.md file and link it from a short 'Edge cases: See [edge-cases.md]' line, letting SKILL.md stay lean.

Consolidate the scattered version pins (llama-index-core 0.14.19/0.14.25, openinference 4.5.2, native otel 0.7.0) into a single compatibility/version table under Step 0 so time-sensitive details are localized and easy to maintain.

DimensionReasoningScore

Conciseness

The body is telegraphic and assumes competence — no padding, no explanation of concepts Claude already knows ('Never run both: every span doubles', 'Silence alone proves nothing'). Docked from 5 for time-sensitive information scattered outside any 'old patterns'/'deprecated' section: 'tested 0.14.25', native otel '0.7.0', 'pin llama-index-core<0.14.25' pending OpenInference PR #3841. Not 3 because there is no unnecessary explanation anywhere.

4 / 5

Actionability

Fully executable and copy-paste ready: a complete verbatim `tracing.py` processor, exact pip pins, an exact `OTEL_EXPORTER_*` env block, and concrete snippets for `using_session(...)`, `instrument_tags(...)`, and `stream_options: {include_usage: true}`. Matches the 5 anchor; not 4 because the common cases (install, init, session id, flush, verify) each come with ready code or commands.

5 / 5

Workflow Clarity

Clear 0-8 step sequence (Detect → Key/region → Install+init → Session id → Content → Tools/sub-agents → Tokens → Flush → Verify) with an explicit verification checklist in Step 8 and feedback loops (401 → try the other region; 'Silence alone proves nothing' → console-span fallback check; 'Ask before removing'). Matches the 5 anchor's explicit validation steps and checklists; not 4 because every checkpoint is present, including a no-Maple-access fallback.

5 / 5

Progressive Disclosure

Well-organized single-file structure with clearly numbered sections and no nested references — but the ~40-line Edge cases tail (native otel 0.7.0 details, CondensePlusContextChatEngine span layout, OpenRouter Broadcast nesting, streaming query engine pin) is situational material inlined in SKILL.md that fits a one-level reference file. Matches the 4 anchor ('good structure; most content appropriately placed; minor organization gaps'); not 5 because nothing is offloaded, and not 3 because the core procedure legitimately belongs inline and navigation is easy.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: third-person, dense with concrete capabilities, and equipped with an explicit trigger clause covering natural phrasings and both spellings of the framework name. It fully answers what the skill does and when to use it with minimal conflict risk.

DimensionReasoningScore

Specificity

Lists multiple specific concrete capabilities — 'OpenInference LlamaIndex instrumentor with GenAI output, a conversation id per chat, agent names and one span per model call, so each conversation is one Maple Agent Session with transcript, tools and tokens' — comprehensively covering what the skill delivers. Matches the 5 anchor ('multiple specific concrete actions; comprehensive coverage'); not 4 because no meaningful capability is left out.

5 / 5

Completeness

Explicitly answers 'what' (instrument LlamaIndex agents so each conversation is one Maple Agent Session with transcript, tools and tokens) and 'when' via an explicit 'Triggers on ...' clause with concrete phrases. Matches the 5 anchor exactly; the 'Use when...' cap at 3 does not apply.

5 / 5

Trigger Term Quality

Five natural trigger phrases users would actually say ('trace my llamaindex agent', 'add Maple to llamaindex', 'agent sessions for llamaindex', 'OpenTelemetry for llamaindex', 'llama-index observability'), including the llamaindex/llama-index spelling synonyms. Matches the 5 anchor's comprehensive coverage with synonyms; not 4 because trace/add/sessions/observability/OTel phrasings are all covered.

5 / 5

Distinctiveness Conflict Risk

Clear niche locked to both 'Maple' and 'LlamaIndex' with triggers that mix the two ('add Maple to llamaindex'); a user saying these phrases unambiguously wants this skill. Minimal conflict risk; not 4 because even the more generic phrases ('llama-index observability') are within this skill's legitimate scope of handling existing OTel setups.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

MapleTechLabs/maple

Path

skills/maple-agent-tracing-llamaindex/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.