OpenTelemetry Collector deployment, instrumentation (Java/Python/Node.js/.NET/Go), and OTTL pipeline transforms for Coralogix — coralogix exporter config, Helm chart selection, Kubernetes topology, ECS/EKS/GKE deployments, SDK setup, APM transactions, and OTTL cardinality/PII/routing.
98
97%
Does it follow best practices?
Impact
99%
1.13xAverage score across 81 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "Evaluating a Coralogix support response for this user question:\n\nI wrote a Python script that records some spans and a counter metric, then exits. The script finishes in about half a second. Nothing shows up in Coralogix — no traces, no metrics. What should I check?",
"type": "weighted_checklist",
"checklist": [
{
"name": "mentions-simplespanprocessor",
"description": "The response contains \"SimpleSpanProcessor\" (case-insensitive).",
"max_score": 3
},
{
"name": "mentions-batchspanprocessor",
"description": "The response contains \"BatchSpanProcessor\" (case-insensitive).",
"max_score": 3
},
{
"name": "mentions-periodicexporting",
"description": "The response contains \"PeriodicExporting\" (case-insensitive).",
"max_score": 3
},
{
"name": "no-if-it-only-identifies-one-issue-or-if-it-m",
"description": "Identifies TWO root causes specific to short-lived scripts: (1) BatchSpanProcessor queues spans and may not flush before the process exits — for scripts use SimpleSpanProcessor which exports synchronously on span.end(); (2) PeriodicExportingMetricReader only exports on its timed interval — a script that exits before the interval fires exports zero metrics; fix by sleeping longer than the export interval or calling force_flush() on the reader before shutdown(). FAIL if it only identifies one issue, or if it does not mention both the span processor and the metric reader export timing problem.",
"max_score": 2
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10
scenario-11
scenario-12
scenario-13
scenario-14
scenario-15
scenario-16
scenario-17
scenario-18
scenario-19
scenario-20
scenario-21
scenario-22
scenario-23
scenario-24
scenario-25
scenario-26
scenario-27
scenario-28
scenario-29
scenario-30
scenario-31
scenario-32
scenario-33
scenario-34
scenario-35
scenario-36
scenario-37
scenario-38
scenario-39
scenario-40
scenario-41
scenario-42
scenario-43
scenario-44
scenario-45
scenario-46
scenario-47
scenario-48
scenario-49
scenario-50
scenario-51
scenario-52
scenario-53
scenario-54
scenario-55
scenario-56
scenario-57
scenario-58
scenario-59
scenario-60
scenario-61
scenario-62
scenario-63
scenario-64
scenario-65
scenario-66
scenario-67
scenario-68
scenario-69
scenario-70
scenario-71
scenario-72
scenario-73
scenario-74
scenario-75
scenario-76
scenario-77
scenario-78
scenario-79
scenario-80
scenario-81
skills
opentelemetry
opentelemetry-collector
references
opentelemetry-instrumentation
opentelemetry-ottl