CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/cfn-behavior-validator

Creates test stacks, analyzes CloudFormation events, and compares actual vs documented update behavior to validate whether resource property changes trigger replacement or in-place updates. Use when: a user wants to test if a CFN property change causes resource replacement; when investigating stack update behavior or "Update requires" documentation accuracy; when validating whether a workaround (e.g. hash-based logical IDs) is actually necessary; when questioning UpdateRequiresReplacement behavior for immutable properties; when empirical evidence is needed before an architectural decision involving CDK or CloudFormation stack updates.

Does it follow best practices?

Evaluation100%

1.12x

Agent success when using this tile

Validation for skill structure

Overview
Skills
Evals
Files

Evaluation results

100%

8%

Investigate SNS Subscription Endpoint Change Behavior

Complete validation workflow research and documentation

Criteria
Without context
With context

CFN docs lookup

100%

100%

Community research

100%

100%

Hypothesis stated

100%

100%

Non-prod environment

75%

100%

Resource isolation

100%

100%

Observable criteria

100%

100%

CFN events inspection

25%

100%

Required report fields

100%

100%

Behavior classification

100%

100%

Workaround decision

100%

100%

Without context: $0.7010 · 4m 3s · 23 turns · 1,491 in / 10,975 out tokens

With context: $0.7827 · 3m 5s · 31 turns · 28 in / 10,594 out tokens

100%

Design Test Infrastructure for Lambda Memory Configuration

CDK test stack design and parameterization

Criteria
Without context
With context

Context parameterization

100%

100%

Minimal resources

100%

100%

Single property focus

100%

100%

Observable criteria defined

100%

100%

Success criteria explicit

100%

100%

Verification method

100%

100%

Valid CDK syntax

100%

100%

Without context: $0.3141 · 1m 36s · 12 turns · 13 in / 4,953 out tokens

With context: $0.5708 · 2m 3s · 22 turns · 69 in / 6,653 out tokens

100%

12%

Execute DynamoDB Table Class Change Validation

Deployment commands and event inspection

Criteria
Without context
With context

Initial deployment command

100%

100%

No approval flag

100%

100%

Resource ARN recording

100%

100%

Redeploy after change

100%

100%

describe-stack-events command

100%

100%

Resource type filter

0%

100%

Event field extraction

100%

100%

Replacement indicators

100%

100%

Update indicators

100%

100%

Failure handling

100%

100%

Without context: $0.3038 · 1m 31s · 8 turns · 57 in / 6,497 out tokens

With context: $0.3549 · 1m 58s · 13 turns · 1,524 in / 5,331 out tokens

100%

2%

Handle Unexpected Behavior in RDS Instance Storage Change

Validation gates and repeatability testing

Criteria
Without context
With context

Initial deployment failure gate

100%

100%

Unexpected behavior gate

83%

100%

Ambiguous results handling

100%

100%

Repeat test condition

100%

100%

Cleanup between tests

100%

100%

Pre-repeat verification

100%

100%

Additional data collection

100%

100%

Multiple decision points

100%

100%

Stop conditions clear

100%

100%

Without context: $0.1918 · 1m 12s · 6 turns · 7 in / 3,871 out tokens

With context: $0.4897 · 1m 58s · 23 turns · 364 in / 5,814 out tokens

100%

33%

Automate ECS Task Definition Memory Change Validation

Helper scripts and automation tools

Criteria
Without context
With context

Real-time event streaming

100%

100%

watch-cfn-events reference

25%

100%

Resource comparison mentioned

100%

100%

compare-resources reference

10%

100%

Before state capture

100%

100%

After state capture

100%

100%

Sequential workflow

100%

100%

Without context: $0.2678 · 1m 14s · 10 turns · 11 in / 4,612 out tokens

With context: $0.5272 · 1m 47s · 23 turns · 20 in / 5,961 out tokens

Install with Tessl CLI

npx tessl i pantheon-ai/cfn-behavior-validator
Evaluated
Agent
Claude Code

Table of Contents