CtrlK
BlogDocsLog inGet started
Tessl Logo

running-release-tests

Run automated release testing (UI or API) via the AWS DevOps Agent using a pre-configured test profile. Use when the user wants to validate multi-step workflows, verify features, check for regressions, or test API endpoints. Trigger words include run tests, UAT, test my app, test profile, UI test, API test, automated testing, regression test, QA, end-to-end test, run the QA agent.

70

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

77%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with executable commands and a clearly sequenced workflow that includes explicit checkpoints and error-recovery loops. Its main weaknesses are duplicated content between the primary and fallback paths and a monolithic structure with no external reference files.

Suggestions

Extract the 'Fallback (aws-mcp)' path into a separate reference file (e.g. references/fallback-aws-cli.md) and link to it, removing the duplicated 'Select Agent Space' and monitor steps from the main body.

Collapse the shared steps (Select Agent Space, Poll, Monitor, Present Results) so they are stated once, with only the tool-specific differences shown for each path.

DimensionReasoningScore

Conciseness

The body avoids explaining concepts Claude already knows and is mostly commands, but it duplicates the entire workflow for the aws-mcp fallback and repeats the 'Select Agent Space' step verbatim, adding avoidable length.

2 / 3

Actionability

Provides fully executable commands and tool calls with exact flags and parameters (e.g. 'aws devops-agent create-backlog-task --task-type RELEASE_TESTING ...') and a concrete output filename pattern — copy-paste ready.

3 / 3

Workflow Clarity

Clear numbered sequence with explicit validation checkpoints ('Do NOT proceed until the user has selected one', 'MUST wait for the user to respond'), polling intervals, terminal-state checks, and throttle/retry + cancel feedback loops for error recovery.

3 / 3

Progressive Disclosure

No bundle files exist and the skill is a single ~197-line file; sections are well-organized but the entire fallback path is inline rather than split to a reference, so content that could be separate is not.

2 / 3

Total

10

/

12

Passed

Description

92%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong: concrete capabilities, explicit 'Use when' guidance, and a wide range of natural trigger terms. Its only weakness is that several generic testing trigger words (run tests, QA, test my app) could cause overlap with broader testing skills.

Suggestions

Tie generic trigger words to the AWS DevOps Agent context (e.g. 'run release tests via the AWS DevOps Agent', 'run a QA agent job') so they don't overlap with generic testing skills.

Consider dropping or narrowing the most generic terms ('run tests', 'QA') in favor of more distinctive ones ('release test profile', 'AWS DevOps Agent QA').

DimensionReasoningScore

Specificity

Lists multiple concrete actions ('validate multi-step workflows, verify features, check for regressions, or test API endpoints') and a concrete mechanism (AWS DevOps Agent with a pre-configured test profile), matching the 'lists multiple specific concrete actions' anchor.

3 / 3

Completeness

Explicitly answers both 'what' ('Run automated release testing (UI or API) via the AWS DevOps Agent using a pre-configured test profile') and 'when' via an explicit 'Use when the user wants to...' clause with concrete triggers.

3 / 3

Trigger Term Quality

Provides a broad set of natural terms a user would actually say — 'run tests, UAT, test my app, test profile, regression test, QA, end-to-end test' — covering common variations rather than technical jargon.

3 / 3

Distinctiveness Conflict Risk

The AWS DevOps Agent + test-profile niche is distinct, but several triggers ('run tests', 'test my app', 'automated testing', 'QA') are generic and could overlap with other testing skills, so it does not fully reach the 'clear niche with distinct triggers' anchor.

2 / 3

Total

11

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
aws/agent-toolkit-for-aws
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.