CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

otel-collector-config-tester

Use when an OpenTelemetry Collector config changes (a new receiver, processor or exporter) and must be verified before deploy. Runs otelcol validate, uses the debug or file exporter to assert spans flow through the pipeline, and wires the check into CI.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/otel-collector-config-tester

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly executable procedure with explicit validation checkpoints at every step and proper use of a one-level-deep reference for the full CI workflow. The main weaknesses are the un-shown grpcurl test-span payload and the missing tests/send_test_spans.py script that the CI step depends on, plus minor YAML repetition across steps.

Suggestions

Include a minimal test-span.json example (or an alternative OTLP/HTTP curl payload) so the grpcurl send step in Step 2 is copy-paste runnable without the user authoring a payload from scratch.

Ship tests/send_test_spans.py in the bundle's scripts/ directory (or inline a minimal Python OTel SDK snippet) since both the Step 5 CI snippet and references/ci-integration.md depend on it but it is absent from the bundle.

Trim the repeated receivers/service.pipelines YAML scaffolding in Steps 2-4 to only the delta (the exporters and processors blocks), reducing token cost without losing executability.

DimensionReasoningScore

Conciseness

Mostly efficient - every section carries commands, configs, or failure-mode guidance with no general-concept padding - but the YAML blocks in Steps 2-4 repeat the receivers/service.pipelines scaffolding and a few asides ("The Transform processor uses OTTL (OpenTelemetry Transformation Language) for advanced mutations", "which allows multiple instances of the same type") could be trimmed. This sits at the 4 anchor (efficient, minor over-explanation), not 3 (no padded explanations) and not 5 (repetition exists).

4 / 5

Actionability

Highly executable: `otelcol validate --config=collector-config.yaml`, the grpcurl invocation, grep/wc/jq assertion snippets, docker run commands, and a complete filter processor config. Two gaps keep it from 5: the grpcurl payload file `test-span.json` is referenced but never shown, and `tests/send_test_spans.py` - used in the CI step - is neither in the bundle nor sketched, so the send-span step is not copy-paste ready.

4 / 5

Workflow Clarity

Steps 1-5 are clearly sequenced (validate syntax, observe with debug exporter, assert with file exporter, test processor behavior, integrate into CI) and every step ends in an explicit checkpoint: non-zero exit blocks the pipeline, `|| { echo "No spans exported"; exit 1; }`, jq -e assertions, and flush-interval wait guidance. The anti-patterns table with fixes serves as an error-recovery checklist, matching the 5 anchor.

5 / 5

Progressive Disclosure

The core procedure stays inline in a well-sectioned body while the full CI workflow is offloaded to references/ci-integration.md (verified to exist), linked with a clear one-level-deep signal ("Full workflow with checkout, startup gating, and teardown"). Headers, the minimal-shape inline CI snippet plus pointer pattern, and an organized external-references section make navigation easy - matching the 5 anchor.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete third-person actions, an explicit and specific Use-when clause, and domain-precise trigger terms. The only weakness is missing natural synonyms such as "traces" or "telemetry" that some users would use when asking for this skill.

DimensionReasoningScore

Specificity

Lists multiple concrete actions - "Runs otelcol validate", "uses the debug or file exporter to assert spans flow through the pipeline", "wires the check into CI" - naming the exact tool, exporters, and assertion target. Coverage is comprehensive for the domain with no gaps, matching the 5 anchor rather than 4.

5 / 5

Completeness

Explicitly answers both: "Use when an OpenTelemetry Collector config changes (a new receiver, processor or exporter) and must be verified before deploy" gives concrete when-triggers, and the three named actions give a clear what. The when clause is explicit and specific, matching the 5 anchor rather than the 4 anchor's looser trigger; voice is third person throughout.

5 / 5

Trigger Term Quality

Natural phrases like "OpenTelemetry Collector config", "receiver, processor or exporter", "spans", and "CI" match what users in this domain would say, but common synonyms such as "traces" or "telemetry" are absent. Good coverage with a few natural terms missing fits the 4 anchor, short of the synonym-level comprehensiveness of 5.

4 / 5

Distinctiveness Conflict Risk

Clear niche (Collector config verification before deploy) with distinct triggers like "otelcol validate" and "debug or file exporter". Overlap risk is minimal - only adjacent observability skills, and the skill body already disambiguates the sampling-verification neighbor.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

testland/qa

Path

plugins/qa-distributed-tracing/skills/otel-collector-config-tester/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.