CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/idempotency-test-author

Build-an-X for idempotency tests in any async/job/API context - idempotency-key handling (per Stripe / AWS prescriptive guidance pattern), retry-safe semantics (exactly-once vs at-least-once vs at-most-once), side-effect commutativity verification, fingerprint-based dedup, idempotency-window tuning. Use when authoring tests for any system where the same input could be processed twice (SQS Standard at-least-once, RabbitMQ requeue, retry-on-error logic, webhook redelivery, browser double-click, mobile-network retry).

75

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable test-authoring skill with executable code, a clear sequenced workflow, and clean one-level-deep progressive disclosure. The only weakness is minor verbosity in the Overview, which restates the description.

Suggestions

Trim the Overview so it does not restate the frontmatter description; remove the filler 'Sources in References.' line and fold the [aws-idem] link definition into the References section.

Replace the leftover 'Build-an-X' phrasing in the description with a direct capability statement (e.g., 'Authors idempotency tests…') for a more polished trigger.

DimensionReasoningScore

Conciseness

Mostly efficient and code-forward, but the Overview paragraph restates the frontmatter description and 'Sources in References.' is filler, so it could be tightened — matching the level-2 'mostly efficient but could be tightened' anchor rather than the lean level-3 anchor.

2 / 3

Actionability

Provides fully executable pytest code (IdempotentEndpoint, duplicate-key, hash-mismatch, TTL-freezer, concurrent-duplicate tests) and concrete TTL tables, with the referenced bundle containing complete runnable test code — matching the level-3 copy-paste-ready anchor.

3 / 3

Workflow Clarity

A clear Step 1–7 sequence culminating in an explicit end-to-end checklist (Step 7) plus an anti-patterns table for error recovery; no validate-fix loop is required since this is test authoring, not destructive/batch operations.

3 / 3

Progressive Disclosure

SKILL.md is a concise overview with one-level-deep, clearly signaled references to the real references/idempotency-patterns.md (Steps 4 and 6), with content appropriately split and easy to navigate — matching the level-3 anchor.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description with an explicit 'Use when' trigger and concrete capability list plus natural trigger terms drawn from real broker/retry scenarios. The only blemish is the leftover 'Build-an-X' scaffolding phrase, which reads as template residue rather than a capability statement.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'idempotency-key handling', 'retry-safe semantics (exactly-once vs at-least-once vs at-most-once)', 'side-effect commutativity verification', 'fingerprint-based dedup', 'idempotency-window tuning' — matching the level-3 anchor rather than the single-domain level-2 anchor.

3 / 3

Completeness

Explicitly answers both what (the five capabilities) and when via an explicit 'Use when authoring tests for any system where the same input could be processed twice' clause, satisfying the level-3 anchor; the 'Use when' presence also avoids the level-2 cap.

3 / 3

Trigger Term Quality

Good coverage of natural terms users would say — 'SQS Standard at-least-once', 'RabbitMQ requeue', 'retry-on-error logic', 'webhook redelivery', 'browser double-click', 'mobile-network retry' — well beyond the level-2 'some relevant keywords' anchor.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche (idempotency tests for at-least-once/retry systems) with distinct, specific triggers unlikely to fire for unrelated test-authoring skills, matching the level-3 anchor.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents