flaky-test-detector

Flaky Test Detector - Auto-activating skill for Test Automation. Triggers on: flaky test detector, flaky test detector Part of the Test Automation skill category.

0.98x

Quality

Does it follow best practices?

Impact

91%

0.98x

Average score across 3 eval scenarios

Securityby

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./planned-skills/generated/09-test-automation/flaky-test-detector/SKILL.md

Evaluation results

92%

-3%

Flaky Test Audit — E-commerce Checkout Service

Step-by-step flaky test analysis with Jest

Criteria

Without context

With context

Structured steps

100%

Timing/async pattern identified

100%

Shared state pattern identified

100%

External dependency pattern identified

100%

Flakiness categories used

100%

Per-test severity or risk rating

100%

Production-ready output format

100%

Jest-specific remediation

100%

Unit vs integration distinction

100%

62%

Standards validation statement

37%

85%

-3%

Automated Flaky Test Detector for a Python Microservice CI Pipeline

Production-ready pytest flaky test detection script

Criteria

Without context

With context

CLI argument support

100%

Multiple-run detection logic

100%

Flakiness rate calculation

100%

Error handling

60%

Structured results output

100%

Pytest-specific integration

100%

Step-by-step usage documentation

100%

Configurable run count

100%

Standards-based flakiness threshold

80%

70%

Integration test awareness

25%

96%

Test Suite Reliability Review — SaaS Notification Service

Mocking and test framework configuration flakiness review

Criteria

Without context

With context

Incomplete mock teardown

100%

Module-level mock scope issue

100%

Timer/date mock misconfiguration

100%

Step-by-step remediation

100%

Framework-specific mock fix

100%

Jest config recommendation

100%

TDD pattern observation

75%

87%

Unit vs integration scope

62%

Validation summary

100%

Produces written artifact

100%

Repository: jeremylongshore/claude-code-plugins-plus-skills
Commit: 3e83543

Evaluated: 27 days ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Flaky Test Audit — E-commerce Checkout Service Automated Flaky Test Detector for a Python Microservice CI Pipeline Test Suite Reliability Review — SaaS Notification Service

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.