CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/mqtt-tests

Use when a product speaks MQTT, STOMP or AMQP and its delivery guarantees need broker-backed tests: QoS 0, 1 and 2, retained messages, Last Will, shared subscriptions and $SYS with Mosquitto and paho-mqtt; STOMP and RabbitMQ AMQP tests via Testcontainers are in its references.

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable skill: executable CI and test code, a clear sequenced workflow, real reference files, and a useful anti-patterns table. The main weaknesses are minor re-explanations of MQTT concepts Claude already knows, code snippets that omit imports, and no feedback loop for diagnosing failed redelivery assertions.

Suggestions

Trim or move the QoS semantics table and the quoted spec sentence — Claude already knows what QoS 0/1/2 mean; keep only the test-relevant implications (e.g., the clean_start=False requirement).

Make code snippets fully self-contained by including `import time` (and noting the pytest context) so each test function is genuinely copy-paste ready.

Add a short error-recovery note for the QoS 1 redelivery test — what to check when the assert fails (session state, broker persistence config, client_id collisions) — to complete the workflow's feedback loop.

DimensionReasoningScore

Conciseness

The body is largely efficient with executable code and tight sections, but it includes explanations Claude already knows: the QoS semantics table ('At most once (best effort, may be lost)'), the quoted spec sentence about retained messages, and 'Per the [MQTT v5.0 spec]' repeated three times — fitting anchor 4 (efficient with minor over-explanation to trim) rather than 3, since the padding is incidental rather than structural.

4 / 5

Actionability

Guidance is mostly executable — CI service YAML, a complete mosquitto.conf, and runnable pytest functions with real assertions — but `import time` is never shown in any snippet and the advanced behaviors named in the description (LWT, shared subscriptions, $SYS) have no inline example, only a pointer. This is anchor 4 (concrete code with minor gaps), not 5 (fully copy-paste ready covering common cases).

4 / 5

Workflow Clarity

'How to use' provides a numbered 6-step sequence cross-referenced to Steps 1–4, the code's asserts serve as validation checkpoints, and the anti-patterns table lists failure modes with fixes. However, there is no error-recovery guidance (e.g., what to inspect when the QoS 1 redelivery assert fails), so it matches anchor 4 (clear sequence, most checkpoints) rather than 5 (explicit feedback loops).

4 / 5

Progressive Disclosure

The body keeps the core workflow inline and splits advanced material into two clearly signaled, one-level-deep references (references/lwt-shared-subs-sys.md and references/stomp-amqp.md), both of which exist as real files with no nested references — matching the anchor 5 structure of overview plus well-signaled reference files.

5 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it names a precise niche (broker-backed delivery-guarantee testing), lists concrete capabilities across MQTT/STOMP/AMQP, and opens with an explicit 'Use when' trigger clause. The only weakness is modest synonym coverage (e.g., IoT, pub/sub, telemetry) for users who describe the need without naming the protocol.

DimensionReasoningScore

Specificity

The description enumerates concrete capabilities — 'QoS 0, 1 and 2, retained messages, Last Will, shared subscriptions and $SYS with Mosquitto and paho-mqtt; STOMP and AMQP tests via Testcontainers' — which is comprehensive coverage of the skill's surface, matching the anchor 5 example; anchor 4 would require identifiable coverage gaps, and none are present.

5 / 5

Completeness

It explicitly answers both questions: 'Use when a product speaks MQTT, STOMP or AMQP and its delivery guarantees need broker-backed tests' is a concrete when-clause, and the enumerated QoS/retained/LWT/shared-subscription/$SYS capabilities are a clear what — matching the anchor 5 example structure.

5 / 5

Trigger Term Quality

Natural trigger terms are strong ('MQTT, STOMP or AMQP', 'QoS', 'retained messages', 'Last Will', 'Mosquitto', 'paho-mqtt', 'broker'), but common user synonyms like 'IoT', 'pub/sub', 'message broker' or 'telemetry' are absent, placing it between the 'good coverage with a few missing' (4) and 'comprehensive synonyms' (5) anchors.

4 / 5

Distinctiveness Conflict Risk

The triggers are sharply niche (MQTT/STOMP/AMQP wire protocols with named broker and client libraries), so it would not fire for generic messaging, webhook or REST testing skills — clear niche with minimal conflict risk per the anchor 5 anchor.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page