OpenTelemetry Collector deployment, instrumentation (Java/Python/Node.js/.NET/Go), and OTTL pipeline transforms for Coralogix — coralogix exporter config, Helm chart selection, Kubernetes topology, ECS/EKS/GKE deployments, SDK setup, APM transactions, and OTTL cardinality/PII/routing.
98
97%
Does it follow best practices?
Impact
99%
1.13xAverage score across 81 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "Evaluating a Coralogix support response for this user question:\n\nHow do I send Python application logs to Coralogix using OpenTelemetry? We're on the eu2 region.",
"type": "weighted_checklist",
"checklist": [
{
"name": "mentions-loggerprovider",
"description": "The response contains \"LoggerProvider\" (case-insensitive).",
"max_score": 3
},
{
"name": "mentions-logginghandler",
"description": "The response contains \"LoggingHandler\" (case-insensitive).",
"max_score": 3
},
{
"name": "mentions-setlevel",
"description": "The response contains \"setLevel\" (case-insensitive).",
"max_score": 3
},
{
"name": "mentions-otlplogexporter",
"description": "The response contains \"OTLPLogExporter\" (case-insensitive).",
"max_score": 3
},
{
"name": "mentions-ingress-eu2-coralogix-com-443",
"description": "The response contains \"ingress.eu2.coralogix.com:443\" (case-sensitive).",
"max_score": 3
},
{
"name": "no-if-it-says-https-is-invalid-for-the-python",
"description": "Covers: LoggerProvider with OTLPLogExporter pointing to the Coralogix eu2 ingress endpoint using the standard Coralogix gRPC format \"ingress.eu2.coralogix.com:443\" (bare host:port; https://ingress.eu2.coralogix.com:443 is also valid for Python gRPC and must not be treated as the root cause), with Authorization Bearer header. LoggingHandler bridging stdlib logging to the OTel provider, and the critical note that the root logger level must be set explicitly (e.g. setLevel(logging.INFO)) BEFORE adding the OTel handler — if level is not set, INFO records are filtered by the root logger before they reach any handler. FAIL if it says https:// is invalid for the Python gRPC endpoint, omits the logger-level-setting requirement, or omits the Coralogix endpoint and auth header.",
"max_score": 2
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10
scenario-11
scenario-12
scenario-13
scenario-14
scenario-15
scenario-16
scenario-17
scenario-18
scenario-19
scenario-20
scenario-21
scenario-22
scenario-23
scenario-24
scenario-25
scenario-26
scenario-27
scenario-28
scenario-29
scenario-30
scenario-31
scenario-32
scenario-33
scenario-34
scenario-35
scenario-36
scenario-37
scenario-38
scenario-39
scenario-40
scenario-41
scenario-42
scenario-43
scenario-44
scenario-45
scenario-46
scenario-47
scenario-48
scenario-49
scenario-50
scenario-51
scenario-52
scenario-53
scenario-54
scenario-55
scenario-56
scenario-57
scenario-58
scenario-59
scenario-60
scenario-61
scenario-62
scenario-63
scenario-64
scenario-65
scenario-66
scenario-67
scenario-68
scenario-69
scenario-70
scenario-71
scenario-72
scenario-73
scenario-74
scenario-75
scenario-76
scenario-77
scenario-78
scenario-79
scenario-80
scenario-81
skills
opentelemetry
opentelemetry-collector
references
opentelemetry-instrumentation
opentelemetry-ottl