CtrlK
BlogDocsLog inGet started
Tessl Logo

fastmcp-python-tests

Write and evaluate effective Python tests using pytest. Use when writing tests, reviewing test code, debugging test failures, or improving test coverage. Covers test design, fixtures, parameterization, mocking, and async testing.

68

Quality

82%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

SKILL.md
Quality
Evals
Security

Quality

Content

64%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a solid, actionable skill with excellent executable code examples and important project-specific constraints (asyncio_mode auto, in-memory transport, result.data v3 API). Its main weaknesses are moderate verbosity from explaining general testing principles Claude already knows, and a monolithic structure that could benefit from splitting general pytest knowledge from project-specific rules. The checklist is a nice touch but could be better integrated into a workflow.

Suggestions

Trim general testing advice Claude already knows (e.g., 'A test that tests multiple things is harder to debug and maintain', 'Mock external services, not internal classes') and focus token budget on project-specific rules and constraints.

Consider splitting into SKILL.md (quick reference with project-specific rules, constraints, and checklist) and a PATTERNS.md (detailed examples of fixtures, mocking, parameterization) to improve progressive disclosure.

DimensionReasoningScore

Conciseness

Generally efficient but includes some unnecessary guidance Claude already knows (e.g., 'A test that tests multiple things is harder to debug and maintain', 'Don't parameterize unrelated behaviors', 'Test your code with real implementations when possible'). The 'bad' examples add bulk. However, the project-specific rules (asyncio_mode auto, in-memory transport, result.data v3 constraint) are genuinely valuable non-obvious information.

2 / 3

Actionability

Excellent executable examples throughout — parameterization, fixtures, mocking, error testing, inline snapshots, and in-memory transport patterns are all copy-paste ready with real code. The API version constraint with specific accessor names is highly actionable. CLI commands for running tests and inline-snapshot are concrete.

3 / 3

Workflow Clarity

The checklist at the end provides a good validation step, and the inline-snapshot commands give a clear workflow for snapshot testing. However, there's no explicit end-to-end workflow for writing a test (e.g., write → run → validate → fix cycle). The skill is more of a reference than a guided workflow, which is acceptable for this topic, but the checklist could be better integrated into a sequential process.

2 / 3

Progressive Disclosure

The content is well-organized with clear section headers, but it's a fairly long monolithic document (~170 lines) with no references to supporting files. Some sections like the full mocking guide, fixture patterns, or the inline-snapshot details could be split out. The single external reference to FastMCP testing docs is appropriate but the skill could benefit from splitting project-specific rules vs general pytest guidance.

2 / 3

Total

9

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is a strong skill description that clearly communicates what the skill does (write and evaluate Python tests with pytest), when to use it (writing tests, reviewing test code, debugging failures, improving coverage), and covers specific sub-topics (fixtures, parameterization, mocking, async testing). It uses third person voice correctly and includes natural trigger terms that users would commonly use. The description is concise yet comprehensive.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions and concepts: 'write and evaluate effective Python tests', 'test design, fixtures, parameterization, mocking, and async testing'. These are concrete, actionable capabilities.

3 / 3

Completeness

Clearly answers both 'what' (write and evaluate Python tests using pytest, covering fixtures, parameterization, mocking, async testing) and 'when' (explicit 'Use when writing tests, reviewing test code, debugging test failures, or improving test coverage').

3 / 3

Trigger Term Quality

Includes strong natural keywords users would say: 'tests', 'pytest', 'test failures', 'test coverage', 'fixtures', 'parameterization', 'mocking', 'async testing'. These cover a wide range of terms a user would naturally use when needing this skill.

3 / 3

Distinctiveness Conflict Risk

Clearly scoped to Python testing with pytest specifically. The combination of 'pytest', 'fixtures', 'parameterization', 'mocking', and 'async testing' creates a distinct niche that is unlikely to conflict with general coding or other language testing skills.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation11 / 11 Passed

Validation for skill structure

No warnings or errors.

Repository
Jamie-BitFlight/claude_skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.