CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

aap-mcp-validator

Validate that required AAP MCP servers are accessible before executing automation skills. Use when: - Before any skill that requires AAP MCP access - "Validate AAP MCP", "Check if AAP is configured" - "Verify AAP connection", "Test AAP MCP servers" NOT for: actual automation tasks (use specialized skills instead).

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-sequenced single-file skill: exact tool names, parameters, output template, and an explicit failure/stop rule make it copy-paste executable. Its main weakness is token redundancy — the tool inventory and results table are each duplicated across sections, which could be consolidated without losing any information.

Suggestions

Remove the duplicated MCP tool list in the 'Dependencies' section (or reduce it to a single line pointing back to Step 2), since all six tools and their sources are already enumerated with parameters in Step 2.

Replace the fully worked example table in 'Example Usage' with a one-line pointer to the Step 3 output format plus a short note that a governance assessment validates all 6 servers, cutting ~15 duplicated lines.

Merge the thin 'Related Skills' and 'Reference Documentation' subsections into a single two-line 'Dependencies' note to tighten the closing sections.

DimensionReasoningScore

Conciseness

The core guidance is efficient (no concept over-explanation, tables and terse instructions throughout), but there is real duplication: the six MCP tool/source pairs are listed in full in both 'Step 2: Validate Each Server' and again in 'Dependencies', and the 'Example Usage' section repeats the entire results table already specified as the output format in Step 3. This matches 'mostly efficient but includes some unnecessary explanation or could be tightened' rather than 2, since the redundancy is confined to two sections and the rest is lean.

3 / 5

Actionability

Fully executable guidance: exact MCP tool names per server with concrete parameters ('page_size: 1'), a workflow-to-server mapping table, a copy-paste output format template, and an explicit proceed/stop rule ('If ANY required server fails: report failure and ask user how to proceed'). The worked example covers the common case, matching the top anchor.

5 / 5

Workflow Clarity

The four-step sequence (determine required servers → validate each with minimal list calls → report results in a fixed table → decide proceed/stop) is clear and this skill is itself a validation checkpoint with an explicit failure path ('report failure and ask user how to proceed'). The operation is non-destructive and read-only, so no missing-validation cap applies; sequence and checkpoints match the top anchor.

5 / 5

Progressive Disclosure

No bundle files exist, so the skill is a single well-sectioned SKILL.md; the one external pointer ('mcps.json') is a clearly signaled one-level reference. Structure is good with all sections appropriately placed inline for a single-task skill, but the redundant Dependencies/Example sections and thin 'Reference Documentation'/'Related Skills' blocks are minor organization gaps, keeping it just below the clean-split top anchor.

4 / 5

Total

17

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly answers what the skill does, when to use it with natural quoted trigger phrases, and when not to use it. The only weakness is that it states a single concrete action (validate accessibility) rather than enumerating several specific capabilities, which slightly limits specificity.

DimensionReasoningScore

Specificity

The description names the domain ('required AAP MCP servers') and one concrete action ('Validate that required AAP MCP servers are accessible before executing automation skills'), but does not enumerate several specific actions — matching 'names domain and 1-2 concrete actions, but not comprehensive'. It does not reach 4 because no additional concrete capabilities are listed beyond validate-accessibility, and it is above 2 because the action stated is specific rather than generic.

3 / 5

Completeness

Both parts are explicit: the 'what' ('Validate that required AAP MCP servers are accessible before executing automation skills') and the 'when' with concrete trigger phrases ('Use when: Before any skill that requires AAP MCP access...'), plus a 'NOT for' exclusion clause. This clearly matches the anchor 'clearly and explicitly answers both what AND when with concrete trigger phrases'.

5 / 5

Trigger Term Quality

Explicit natural phrases are quoted: 'Validate AAP MCP', 'Check if AAP is configured', 'Verify AAP connection', 'Test AAP MCP servers' — good keyword coverage across validate/check/verify/test variations users would naturally say. It falls short of 5 because a few natural synonyms (e.g., 'AAP connectivity', 'MCP health check') are absent, though coverage is well above the 'some relevant keywords but missing common variations' of 3.

4 / 5

Distinctiveness Conflict Risk

The skill occupies a clear niche (AAP MCP server connectivity validation) with distinct trigger phrases, and the 'NOT for: actual automation tasks (use specialized skills instead)' boundary explicitly prevents overlap with the automation skills it precedes. Conflict risk is minimal — it would not trigger for the wrong skill.

5 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

RHEcosystemAppEng/agentic-plugins

Path

rh-automation/skills/aap-mcp-validator/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.