bat-adhoc

Run bot acceptance tests to validate MCP tools work correctly from a real AI agent's perspective. Use when testing PRs, detecting regressions, or verifying tool changes end-to-end with Claude/Gemini CLIs.

1.27x

Quality

88%

Does it follow best practices?

Impact

97%

1.27x

Average score across 2 eval scenarios

Securityby

Passed

No findings from the security scan

Evaluation results

100%

PR Validation: Investigate Failed BAT Run

BAT failure diagnosis and regression check

Criteria

Without this skill

With this skill

Phase-level detail cited

100%

Uses --branch master flag

100%

Regression correctly identified

100%

Primary metrics cited

100%

Duration not flagged as regression

100%

95%

42%

Validate a Home Assistant Tool Change with Bot Acceptance Testing

BAT scenario design and execution for tool error-signaling change

Criteria

Without this skill

With this skill

Three-prompt structure

100%

Reporting instruction

100%

Agents flag present

100%

Stdin piping used

100%

Single behavior focus

53%

66%

Runner output captured

100%

Repository: homeassistant-ai/ha-mcp
Path: .claude/skills/bat-adhoc/SKILL.md
Commit: 47582a7

Evaluated: 25 days ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Validate a Home Assistant Tool Change with Bot Acceptance Testing PR Validation: Investigate Failed BAT Run

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.