Author trace-shape assertions in tests using OpenTelemetry SDK in-memory exporter - capture spans during test execution, assert on span name + attributes + status + parent-child structure + duration. Cross-language patterns (Python `InMemorySpanExporter` + `SimpleSpanProcessor`, JS `getRecordedSpans()`, Java `OpenTelemetryExtension`); CI integration. Use when a service is instrumented with the OpenTelemetry SDK and downstream alerts, SLOs, or dashboards depend on specific span names or attributes that a refactor could silently drop.
74
93%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
View guide
Passed
No findings from the security scan
Per the OpenTelemetry traces concept docs, a trace is "the path of a
request through your application" and a span is "a unit of work or
operation". Spans form a directed acyclic graph (DAG) via parent-child
relationships, all sharing the same trace_id.
| Language | Install |
|---|---|
| Python | pip install opentelemetry-sdk |
| JS/TS | npm install @opentelemetry/sdk-trace-base @opentelemetry/sdk-trace-node |
| Java (Maven) | <dependency><groupId>io.opentelemetry</groupId><artifactId>opentelemetry-sdk-testing</artifactId></dependency> |
| .NET | dotnet add package OpenTelemetry --prerelease + OpenTelemetry.Exporter.InMemory |
Per the Python SDK trace docs, use SimpleSpanProcessor for tests
because it "passes ended spans directly to the configured SpanExporter"
synchronously - no batching, no flush wait:
from opentelemetry.sdk.trace.export.in_memory_span_exporter import InMemorySpanExporter
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry import trace
memory_exporter = InMemorySpanExporter()
tracer_provider = TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(memory_exporter))
trace.set_tracer_provider(tracer_provider)
# ... exercise code under test ...
spans = memory_exporter.get_finished_spans()
assert len(spans) == 3
memory_exporter.clear()The clear() call between tests prevents cross-test span leakage.
Per the OpenTelemetry traces concept docs, spans expose name,
attributes, status, and kind:
def test_order_creation_emits_correct_trace():
with use_tracer():
create_order(items=[item])
spans = memory_exporter.get_finished_spans()
span_by_name = {s.name: s for s in spans}
assert "order.create" in span_by_name
order_span = span_by_name["order.create"]
assert order_span.attributes.get("order.item_count") == 1
assert order_span.status.status_code == StatusCode.OK
assert order_span.kind == SpanKind.INTERNALPer the OpenTelemetry traces concept docs: span kind values are
INTERNAL (in-process), CLIENT (outgoing remote), SERVER
(incoming remote), PRODUCER (queue publish), CONSUMER (queue
process).
Per the OpenTelemetry traces concept docs, spans share a trace_id
and reference their parent via parent_id. Assert structure (not
values - IDs are random per run):
db_span = span_by_name["db.query"]
order_span = span_by_name["order.create"]
# Same trace
assert db_span.context.trace_id == order_span.context.trace_id
# DB is a child of order.create
assert db_span.parent.span_id == order_span.context.span_idPer the HTTP semantic conventions docs, required HTTP client span
attributes include http.request.method, url.full, server.address,
server.port, http.response.status_code, and error.type:
assert http_span.attributes["http.request.method"] == "POST"
assert http_span.attributes["url.full"].startswith("https://api.example.com/orders")
assert http_span.attributes["http.response.status_code"] == 201Deprecation note: older SDKs emitted http.method (deprecated).
Per the HTTP semantic conventions docs, the current key is
http.request.method. The OTEL_SEMCONV_STABILITY_OPT_IN env var
controls dual-emit during migration. Tests should assert the new
keys; failures during SDK upgrade are the signal that instrumentation
needs migrating, not that the test is wrong.
import { InMemorySpanExporter, SimpleSpanProcessor } from '@opentelemetry/sdk-trace-base';
import { NodeTracerProvider } from '@opentelemetry/sdk-trace-node';
const memoryExporter = new InMemorySpanExporter();
const provider = new NodeTracerProvider();
provider.addSpanProcessor(new SimpleSpanProcessor(memoryExporter));
provider.register();
// ... exercise ...
const spans = memoryExporter.getFinishedSpans();
expect(spans).toHaveLength(3);
memoryExporter.reset();@RegisterExtension
static final OpenTelemetryExtension otelTesting = OpenTelemetryExtension.create();
@Test
void orderCreateEmitsTrace() {
createOrder(/* ... */);
List<SpanData> spans = otelTesting.getSpans();
assertThat(spans).extracting(SpanData::getName).contains("order.create");
}OpenTelemetryExtension (from opentelemetry-sdk-testing) auto-resets
between tests; no manual clear() needed.
Pin the SDK version in test deps. SDK upgrades change attribute keys (see Step 5 deprecation note); pinning prevents trace assertions from silently changing meaning between releases.
# pytest in CI
- run: |
pip install opentelemetry-sdk==1.29.0
pytest tests/trace/ -v| Anti-pattern | Why it fails | Fix |
|---|---|---|
| Asserting on exact span IDs | IDs are random per run | Assert structure (parent.span_id == X.context.span_id), not values (Step 4) |
| Asserting span count without name lookup | Brittle to instrumentation reorder | Build span_by_name dict (Step 3) |
Use BatchSpanProcessor for tests | Async batching → flaky get_finished_spans() | Always SimpleSpanProcessor for tests (Step 2) |
Skip memory_exporter.clear() between tests | Cross-test span leakage; flake | clear() in fixture teardown (Step 2) |
Assert on legacy http.method keys | Breaks on SDK upgrade to v1.20+ | Use http.request.method (Step 5) |
jaeger-trace-tests /
zipkin-trace-tests for end-to-end trace verification.jaeger-trace-tests,
zipkin-trace-tests - sister
query-based skills for end-to-end verification