CtrlK
BlogDocsLog inGet started
Tessl Logo

maple-agent-tracing-crewai

Trace CrewAI crews and flows with Maple: OpenInference CrewAI instrumentor plus the model-SDK instrumentor, GenAI dual-write, one Maple Agent Session per conversation with transcript, model and tool calls, tokens, failed tools and one lane per agent. Triggers on 'trace my crewai agent', 'add Maple to crewai', 'agent sessions for crewai', 'OpenTelemetry for crewai'.

76

Quality

95%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

96%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An excellent, dense runbook: complete executable code, exact commands and env configuration, explicit verification with troubleshooting feedback loops, and zero filler. The single structural observation is that everything is inlined in one long SKILL.md with no reference files, where a verification-checklist or SDK-mapping reference could reduce always-loaded tokens.

DimensionReasoningScore

Conciseness

Nearly every line carries non-obvious, environment-specific knowledge Claude cannot know: 'CREWAI_TRACING_ENABLED=false stops the AMP uploader and its first-run prompt that waits on stdin at exit', 'akickoff() is NOT instrumented... Replace with await crew.kickoff_async(...)'. There is no padding and no explanation of concepts Claude already knows (no 'what is OpenTelemetry' prose), matching the score-5 anchor ('lean and efficient; every token earns its place'); version pins appear only as practical install constraints, not date-conditional instructions.

5 / 5

Actionability

The guidance is fully executable: a complete copy-paste `tracing.py` (CrewAIAgentNames processor, provider setup, instrument() calls), exact pip/uv install commands, concrete env-var block, `using_session` wrapping examples with real code, and a runnable verification procedure. This matches the score-5 anchor ('fully executable; copy-paste ready code or commands; specific examples cover the common cases').

5 / 5

Workflow Clarity

Steps 0-7 form a clear, ordered pipeline (detect versions -> key/region -> install/init -> session wiring -> content policy -> tools/errors -> flush -> verify), and Step 7 is an explicit validation checkpoint with a checklist plus symptom-to-cause troubleshooting ('If sessions are split per message: using_session missing or id changing. No model spans/tokens: wrong or missing SDK instrumentor.'). Feedback loops are present (verification run, error diagnostics), matching the score-5 anchor.

5 / 5

Progressive Disclosure

The body has good structure: seven numbered step sections, a 'Do not' section, tables for SDK mapping, and code blocks, with no nested or buried references. However, it is a single ~220-line file with no bundle files at all, and some self-contained blocks (the Step 7 verification checklist with edge cases, the Step 0 SDK mapping table) could plausibly live in a reference file read only when needed. This sits between the score-4 anchor ('good structure; most content appropriately placed; minor organization gaps') and the score-5 anchor, which presumes a well-signaled split across files.

4 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete, comprehensive capability enumeration paired with an explicit, natural-language trigger clause, all in third person. The only weakness is trigger-term coverage that stops short of common synonyms and phrasings a user might use.

DimensionReasoningScore

Specificity

The description lists multiple concrete, specific actions: 'Trace CrewAI crews and flows with Maple: OpenInference CrewAI instrumentor plus the model-SDK instrumentor, GenAI dual-write, one Maple Agent Session per conversation with transcript, model and tool calls, tokens, failed tools and one lane per agent.' This is comprehensive coverage of the skill's concrete capabilities with no vague filler; it matches the score-5 anchor ('lists multiple specific concrete actions; comprehensive coverage') and exceeds the score-4 anchor, which requires minor gaps in coverage.

5 / 5

Completeness

It explicitly answers both questions: 'what' is stated concretely (tracing crews/flows with instrumentors, one Agent Session per conversation with transcript, model/tool calls, tokens, lanes) and 'when' is explicit via 'Triggers on ...' with four concrete trigger phrases. This matches the score-5 anchor exactly ('clearly and explicitly answers both what AND when with concrete trigger phrases').

5 / 5

Trigger Term Quality

'Triggers on "trace my crewai agent", "add Maple to crewai", "agent sessions for crewai", "OpenTelemetry for crewai"' provides good, natural keyword coverage a user would plausibly say. It falls short of the score-5 anchor ('comprehensive coverage of natural terms including synonyms') because common variations like 'monitor my crewai agent', 'crewai observability', or 'maple tracing' are missing; it is clearly above the score-3 anchor, which expects missing common variations.

4 / 5

Distinctiveness Conflict Risk

The niche is unambiguous: CrewAI-specific tracing into Maple ('trace my crewai agent', 'agent sessions for crewai'). The stacked qualifiers (CrewAI + Maple + OpenInference) make triggering for the wrong skill very unlikely, matching the score-5 anchor ('clear niche with distinct triggers; minimal conflict risk').

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
MapleTechLabs/maple
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.