OpenTelemetry Collector deployment, instrumentation (Java/Python/Node.js/.NET/Go), and OTTL pipeline transforms for Coralogix — coralogix exporter config, Helm chart selection, Kubernetes topology, ECS/EKS/GKE deployments, SDK setup, APM transactions, and OTTL cardinality/PII/routing.
98
97%
Does it follow best practices?
Impact
99%
1.13xAverage score across 81 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "Evaluating a Coralogix support response for this user question:\n\nI'm running a Java service in Kubernetes and want to use the OpenTelemetry Operator to auto-instrument it without changing the application code. How do I configure it?",
"type": "weighted_checklist",
"checklist": [
{
"name": "mentions-instrumentation",
"description": "The response contains \"Instrumentation\" (case-sensitive).",
"max_score": 3
},
{
"name": "mentions-inject-java",
"description": "The response contains \"inject-java\" (case-sensitive).",
"max_score": 3
},
{
"name": "mentions-cx-application-name",
"description": "The response contains \"cx.application.name\" (case-sensitive).",
"max_score": 3
},
{
"name": "mentions-cx-subsystem-name",
"description": "The response contains \"cx.subsystem.name\" (case-sensitive).",
"max_score": 3
},
{
"name": "no-if-it-omits-the-instrumentation-crd-omits",
"description": "Explains the OpenTelemetry Operator injection flow: create an Instrumentation CRD that specifies the exporter endpoint and resource attributes including cx.application.name, cx.subsystem.name, and service.name; then add the instrumentation.opentelemetry.io/inject-java: \"true\" annotation to the pod or deployment. The endpoint may point to a local OTel Collector or directly to the Coralogix ingress — both are valid; auth headers can be set in Instrumentation.spec.exporter.headers when going direct. Must NOT instruct the user to set JAVA_TOOL_OPTIONS or download the JAR manually — those are bypassed by the Operator. FAIL if it omits the Instrumentation CRD, omits the pod annotation, or instructs manual JAR setup.",
"max_score": 2
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10
scenario-11
scenario-12
scenario-13
scenario-14
scenario-15
scenario-16
scenario-17
scenario-18
scenario-19
scenario-20
scenario-21
scenario-22
scenario-23
scenario-24
scenario-25
scenario-26
scenario-27
scenario-28
scenario-29
scenario-30
scenario-31
scenario-32
scenario-33
scenario-34
scenario-35
scenario-36
scenario-37
scenario-38
scenario-39
scenario-40
scenario-41
scenario-42
scenario-43
scenario-44
scenario-45
scenario-46
scenario-47
scenario-48
scenario-49
scenario-50
scenario-51
scenario-52
scenario-53
scenario-54
scenario-55
scenario-56
scenario-57
scenario-58
scenario-59
scenario-60
scenario-61
scenario-62
scenario-63
scenario-64
scenario-65
scenario-66
scenario-67
scenario-68
scenario-69
scenario-70
scenario-71
scenario-72
scenario-73
scenario-74
scenario-75
scenario-76
scenario-77
scenario-78
scenario-79
scenario-80
scenario-81
skills
opentelemetry
opentelemetry-collector
references
opentelemetry-instrumentation
opentelemetry-ottl