CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/cfn-behavior-validator

Creates test stacks, analyzes CloudFormation events, and compares actual vs documented update behavior to validate whether resource property changes trigger replacement or in-place updates. Use when: a user wants to test if a CFN property change causes resource replacement; when investigating stack update behavior or "Update requires" documentation accuracy; when validating whether a workaround (e.g. hash-based logical IDs) is actually necessary; when questioning UpdateRequiresReplacement behavior for immutable properties; when empirical evidence is needed before an architectural decision involving CDK or CloudFormation stack updates.

77

Quality

97%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

Quality

Content

92%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a tight, actionable, well-sequenced workflow with strong validation checkpoints and no token waste. Its one real weakness is progressive disclosure: the SKILL.md points to scripts and an EXAMPLES.md that are absent from the bundle.

Suggestions

Add the missing bundle files referenced in the body — `scripts/watch-cfn-events.sh`, `scripts/compare-resources.sh`, and `EXAMPLES.md` — so the signaled references resolve to real content.

Alternatively, if those scripts/examples are not yet ready, remove or mark their references (e.g. "(planned)") in the References table and the EXAMPLES.md callout to avoid dead links.

Consider making the CDK stack skeleton slightly more concrete by showing one property-driven resource branch in the `BehaviorTestStack` example, since it is currently a TODO-comment placeholder.

DimensionReasoningScore

Conciseness

The body is lean and assumes Claude's competence — it does not explain what CloudFormation or CDK is, and every section (workflow steps, validation gates, anti-patterns) earns its tokens with actionable guidance.

3 / 3

Actionability

Provides executable commands such as `cdk deploy --require-approval never` and a complete `aws cloudformation describe-stack-events` query with a concrete JMESPath filter; the CDK snippet is intentionally parameterized rather than pseudocode.

3 / 3

Workflow Clarity

A clear four-step sequence (Research → Design → Execute → Document & Decide) with explicit validation gates — "If initial deployment fails → stop and fix", "If behavior is ambiguous → repeat" — providing the feedback loops the rubric requires for destructive stack operations.

3 / 3

Progressive Disclosure

Sections are well-organized and references are clearly signaled in a table, but the referenced bundle files (`./scripts/watch-cfn-events.sh`, `./scripts/compare-resources.sh`, and `EXAMPLES.md`) do not exist in the skill directory, so the one-level-deep navigation is broken.

2 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is third-person, concise yet specific, and pairs concrete capabilities with an explicit multi-trigger "Use when" clause. It cleanly satisfies all four dimensions with no verbosity or over-claiming.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "Creates test stacks, analyzes CloudFormation events, and compares actual vs documented update behavior" — matching the rubric's anchor for multiple specific concrete actions.

3 / 3

Completeness

Explicitly answers both what (creates test stacks, analyzes events, compares actual vs documented behavior) and when via a clear "Use when:" clause with several enumerated triggers.

3 / 3

Trigger Term Quality

Covers natural phrasings a user would actually say: "test if a CFN property change causes resource replacement", "stack update behavior", "Update requires documentation accuracy", and "workaround ... is actually necessary".

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche — empirical validation of CloudFormation update behavior — with triggers specific enough to avoid firing for generic CDK or document skills.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents