running-smoke-tests

This skill runs smoke tests to verify critical application functionality. It executes pre-defined test suites that check system health, authentication, core features, and external integrations. Use this skill after deployments, upgrades, or significant configuration changes to ensure the application is operational. Trigger this skill using the terms "smoke test" or "st".

1.04x

Quality

53%

Does it follow best practices?

Impact

97%

1.04x

Average score across 15 eval scenarios

Securityby

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./backups/skills-migration-20251108-070147/plugins/testing/smoke-test-runner/skills/smoke-test-runner/SKILL.md

Evaluation results

100%

Post-Deployment Smoke Testing for an E-Commerce API

Smoke test suite structure and coverage

Criteria

Without context

With context

System health test

100%

Authentication test

100%

Core features test

100%

External integration test

100%

Per-test pass/fail output

100%

Failure highlighting

100%

Final summary

100%

Speed-conscious design

100%

Configurable base URL

100%

Non-zero exit on failure

100%

Automating Post-Deployment Verification in a GitHub Actions Pipeline

CI/CD pipeline smoke test integration

Criteria

Without context

With context

CI/CD workflow file

100%

Post-deployment trigger

100%

Smoke test step in pipeline

100%

Pipeline fails on test failure

100%

Time constraint respected

100%

System health coverage

100%

Authentication coverage

100%

Core features coverage

100%

External integration coverage

50%

100%

Per-test pass/fail output

100%

Summary output

100%

98%

18%

Building a Smoke Test CLI Runner with Command Recognition

Trigger terms and result reporting

Criteria

Without context

With context

/smoke-test recognition

100%

/st recognition

100%

System health check

100%

Authentication check

100%

Core features check

80%

100%

External integration check

75%

Per-test labeled output

100%

Final summary output

100%

Unrecognized command handling

100%

README with commands documented

100%

96%

-4%

Post-Runtime Upgrade Verification

Category-specific failure highlighting after upgrade

Criteria

Without context

With context

System health check

100%

Authentication check

100%

Core features check

100%

External integration check

100%

Per-test labeled output

100%

Auth failure explicitly identified

100%

84%

Core feature failure explicitly identified

100%

81%

Final summary

100%

Speed-conscious design

100%

Configurable target URL

100%

Non-zero exit on failure

100%

10%

Smoke Test Suite for Revenue-Critical Paths

Critical user flow focus and lean test design

Criteria

Without context

With context

System health check

100%

Authentication check

100%

Core features check

100%

External integration check

100%

Critical path justification

100%

Exclusion rationale

100%

Per-test labeled output

100%

Final summary

100%

Lean suite size

100%

Speed-conscious design

100%

Non-zero exit on failure

100%

99%

Validate Application After Infrastructure Configuration Changes

Post-configuration change targeted validation

Criteria

Without context

With context

System health check

100%

Authentication check

62%

100%

Core features check

87%

100%

External integration check

100%

Per-test labeled output

100%

Integration failure highlighted

100%

Health failure highlighted

100%

87%

Final summary

100%

Speed-conscious design

100%

README with run instructions

100%

Self-contained — no prerequisites

100%

99%

Mobile Banking API Release Verification

Post-release API smoke test with configurable target

Criteria

Without context

With context

System health check

100%

Authentication check

100%

Core features check

100%

External integration check

88%

100%

Per-test labeled output

100%

Auth failure explicitly labeled

60%

90%

Integration failure explicitly labeled

66%

100%

Final summary output

100%

Speed-conscious design

100%

Configurable base URL

100%

Non-zero exit on failure

100%

96%

Post-Upgrade Application Health Verification

Post-upgrade failure highlighting and coverage

Criteria

Without context

With context

System health check

100%

Authentication check

100%

Core features check

100%

External integration check

100%

Per-test labeled output

100%

Category label in failure output

100%

Auth failure category identified

60%

Final summary output

100%

Speed-conscious design

100%

Non-zero exit on failure

100%

Upgrade context documented

100%

92%

-1%

Automated Environment Readiness Verification

DR environment smoke test with CI/CD and environment switching

Criteria

Without context

With context

CI/CD workflow file

100%

Automated trigger configured

100%

System health check

100%

Authentication check

12%

Core features check

100%

External integration check

100%

Configurable target URL

100%

Per-test labeled output

100%

Final summary output

100%

Speed-conscious design

100%

Non-zero exit on failure

100%

Pipeline fails on test failure

100%

Repository: jeremylongshore/claude-code-plugins-plus-skills
Commit: 13d35b8

Evaluated: about 2 months ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Post-Deployment Smoke Testing for an E-Commerce API Automating Post-Deployment Verification in a GitHub Actions Pipeline Building a Smoke Test CLI Runner with Command Recognition Post-Runtime Upgrade Verification Smoke Test Suite for Revenue-Critical Paths Validate Application After Infrastructure Configuration Changes Mobile Banking API Release Verification Post-Upgrade Application Health Verification Automated Environment Readiness Verification

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.