CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/cfn-behavior-validator

Creates test stacks, analyzes CloudFormation events, and compares actual vs documented update behavior to validate whether resource property changes trigger replacement or in-place updates. Use when: a user wants to test if a CFN property change causes resource replacement; when investigating stack update behavior or "Update requires" documentation accuracy; when validating whether a workaround (e.g. hash-based logical IDs) is actually necessary; when questioning UpdateRequiresReplacement behavior for immutable properties; when empirical evidence is needed before an architectural decision involving CDK or CloudFormation stack updates.

Does it follow best practices?

Evaluation100%

1.12x

Agent success when using this tile

Validation for skill structure

Overview
Skills
Evals
Files

task.mdevals/scenario-4/

Handle Unexpected Behavior in RDS Instance Storage Change

Problem Description

Your database team is testing whether changing an RDS instance's allocated storage from 20GB to 100GB triggers instance replacement. During your first test run, you observed some unexpected behavior - the CloudFormation events showed a mix of MODIFY and UPDATE events that don't clearly indicate whether a replacement occurred, and the deployment took longer than expected with some warnings in the event log.

This ambiguous result requires careful analysis and potentially repeating the test to confirm the behavior is consistent.

Output Specification

Create a file analysis-and-response.md that documents:

  1. Initial Test Analysis: How you would analyze the ambiguous results from the first test run
  2. Decision Process: A decision tree or checklist for determining what to do based on different failure/success/ambiguous scenarios including:
    • What to do if initial deployment fails
    • What to do if events show unexpected behavior during the update
    • What to do if results are ambiguous or unclear
    • When to repeat the test for confirmation
  3. Repeatability Plan: If the test needs to be repeated, document:
    • What would be cleaned up from the first test
    • What would be verified before the second run
    • What additional data would be collected
    • How many repetitions would confirm the behavior

The document should demonstrate understanding of proper validation gates and when to stop, investigate, or repeat testing.

Install with Tessl CLI

npx tessl i pantheon-ai/cfn-behavior-validator

evals

SKILL.md

tile.json