CtrlK
BlogDocsLog inGet started
Tessl Logo

golikovichev/postman2pytest

Convert a Postman Collection v2.1 JSON file into a runnable pytest test suite using the postman2pytest CLI. Use when the user has a Postman collection (a .postman_collection.json or v2.1 JSON export) and wants to run it as pytest in CI, when migrating from Postman/Newman to a Python-native test stack, when bridging Postman-documented APIs into a pytest-based regression suite, when the user asks to generate pytest tests from Postman, or when the user mentions wanting to keep Postman as the source of truth but run the suite with pytest.

93

1.00x
Quality

100%

Does it follow best practices?

Impact

100%

1.00x

Average score across 2 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a high-quality skill that is concise, actionable, and well-structured. It provides a clear, sequenced workflow with validation, concrete executable commands, and appropriate progressive disclosure to a reference file. The only minor note is that REFERENCE.md was not provided in the bundle for verification, but the references are clearly signaled and one level deep.

DimensionReasoningScore

Conciseness

The content is lean and efficient. It assumes Claude knows what Postman, pytest, and CI are. Every section earns its place—no unnecessary explanations of basic concepts. The skill appropriately delegates detailed content to REFERENCE.md.

3 / 3

Actionability

Provides fully executable, copy-paste-ready bash commands for installation, conversion, verification, and running. The example showing generated function names and the --filter-folder flag gives concrete, specific guidance. Common errors section provides actionable fixes.

3 / 3

Workflow Clarity

The quick start is a clear 7-step sequence with an explicit validation checkpoint (step 4: grep to verify test count matches request count). The workflow includes environment setup before running, and step 7 closes the loop with commit and re-run guidance. For this non-destructive code generation task, the validation is appropriate.

3 / 3

Progressive Disclosure

Excellent structure: concise overview in SKILL.md with well-signaled, one-level-deep references to REFERENCE.md for CLI flags, CI templates, stress testing, error trees, and auth scrubbing. Content is appropriately split between the quick-start overview and detailed reference material.

3 / 3

Total

12

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is an excellent skill description that clearly defines a narrow, specific capability (Postman-to-pytest conversion), names the exact tool and formats involved, and provides comprehensive trigger scenarios via an explicit 'Use when...' clause. It uses proper third-person voice and includes a rich set of natural keywords that users would realistically use when needing this functionality.

DimensionReasoningScore

Specificity

Lists concrete actions: 'Convert a Postman Collection v2.1 JSON file into a runnable pytest test suite using the postman2pytest CLI.' This names the specific input format, output artifact, and the tool used.

3 / 3

Completeness

Clearly answers both 'what' (convert Postman Collection v2.1 JSON into a pytest test suite using postman2pytest CLI) and 'when' (explicit 'Use when...' clause with five distinct trigger scenarios covering migration, CI, and generation use cases).

3 / 3

Trigger Term Quality

Excellent coverage of natural terms users would say: 'Postman collection', '.postman_collection.json', 'v2.1 JSON export', 'pytest', 'CI', 'Newman', 'Python-native test stack', 'regression suite', 'generate pytest tests from Postman', 'source of truth'. These cover many natural phrasings a user might use.

3 / 3

Distinctiveness Conflict Risk

Highly distinctive niche: the intersection of Postman collections and pytest generation is very specific and unlikely to conflict with general testing skills, general Postman skills, or general pytest skills. The mention of the specific CLI tool 'postman2pytest' further narrows the scope.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation11 / 11 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents