CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/ansible-validator

Comprehensive toolkit for validating, linting, testing, and automating Ansible playbooks, roles, and collections. Use this skill when working with Ansible files (.yml, .yaml playbooks, roles, inventories), validating automation code, debugging playbook execution, performing dry-run testing with check mode, or working with custom modules and collections.

Overall
score

93%

Does it follow best practices?

Validation for skill structure

Overview
Skills
Evals
Files

Discovery

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is an excellent skill description that hits all the key criteria. It provides specific capabilities, includes comprehensive trigger terms that Ansible users would naturally use, explicitly states when to use the skill, and is clearly distinguishable from other automation or YAML-related skills through Ansible-specific terminology.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions: 'validating, linting, testing, and automating Ansible playbooks, roles, and collections' along with 'debugging playbook execution, performing dry-run testing with check mode.'

3 / 3

Completeness

Clearly answers both what ('validating, linting, testing, and automating Ansible playbooks, roles, and collections') AND when with explicit 'Use this skill when...' clause covering multiple trigger scenarios.

3 / 3

Trigger Term Quality

Excellent coverage of natural terms users would say: 'Ansible', 'playbooks', 'roles', 'collections', '.yml', '.yaml', 'inventories', 'check mode', 'custom modules', 'automation code' - these are terms Ansible users naturally use.

3 / 3

Distinctiveness Conflict Risk

Highly distinctive with Ansible-specific terminology (playbooks, roles, collections, check mode, inventories) that clearly separates it from generic YAML or automation skills.

3 / 3

Total

12

/

12

Passed

Implementation

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a high-quality skill with excellent actionability and workflow clarity. It provides comprehensive, executable guidance for Ansible validation with clear decision trees, validation checkpoints, and concrete script references. Minor verbosity from repeated emphasis on critical behaviors and some redundancy between the decision tree and workflow examples sections slightly impacts token efficiency.

DimensionReasoningScore

Conciseness

The skill is mostly efficient with good code examples and tables, but includes some redundancy (e.g., the workflow examples at the end largely repeat the decision tree, and some explanations like 'CRITICAL' and 'IMPORTANT' callouts are repeated multiple times).

2 / 3

Actionability

Provides fully executable bash commands and ansible commands throughout, with specific script paths, concrete examples showing good vs bad patterns, and copy-paste ready code blocks for all major operations.

3 / 3

Workflow Clarity

Excellent decision tree with numbered steps, clear validation sequence, explicit checkpoints (validate → fix → retry pattern), and specific guidance on what to do when molecule tests fail vs when role code fails. The dual scanning requirement and mandatory reference consultation are clearly stated.

3 / 3

Progressive Disclosure

Well-structured with clear overview, summarized core capabilities, and explicit references to external files (references/common_errors.md, references/best_practices.md, etc.) that are one level deep. The scripts reference table and references table provide clear navigation.

3 / 3

Total

11

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation11 / 11 Passed

Validation for skill structure

No warnings or errors.

Install with Tessl CLI

npx tessl i pantheon-ai/ansible-validator@0.1.0

Reviewed

Table of Contents