CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

gui-automation

Use when you need to visually interact with a GUI: test buttons, fill forms, verify visual layouts, fuzz web pages, automate user flows, take screenshots, or perform end-to-end QA on any application. Works on cloud VMs, Docker containers, local machines, and sandboxes. Needs the `cua` CLI (curl -fsSL https://cua.ai/install.sh | sh).

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is gui-automation in trycua/cua

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Excellent command-centric skill body: fully executable examples, an explicit look-act-verify workflow with screenshot verification checkpoints, and clean progressive disclosure into a genuine reference file. The only weakness is minor duplication between sections.

Suggestions

Drop the 'Click a button' scenario — it repeats the Workflow example verbatim and adds nothing.

Merge the Providers table into the Setup section (both enumerate the same `cua do switch` target variants) to remove the duplication.

DimensionReasoningScore

Conciseness

Efficient and command-first — sections like Setup, Workflow, and Zoom convey non-obvious operational knowledge ('Re-screenshot after every UI change: coordinates go stale when the screen changes') with no concept explanations Claude already knows. Minor trimmable duplication: the 'Click a button' scenario repeats the Workflow example verbatim, and the Providers table restates the Setup switch variants — anchor 4, not 5 because a few tokens don't earn their place; not 3 because the padding is minor.

4 / 5

Actionability

Every section consists of copy-paste-ready `cua` commands with concrete arguments and coordinates (e.g., 'cua do click 400 200 && cua do type "Jane Doe"', 'cua do zoom "Google Chrome"'), and the Quick Reference table gives exact syntax per action. Fully executable guidance covering the common cases — anchor 5.

5 / 5

Workflow Clarity

The core process is an explicit named loop — 'Look → Act → Verify: repeat until done' — with an explicit checkpoint rule ('Re-screenshot after every UI change: coordinates go stale when the screen changes') serving as error-recovery feedback, and every scenario ends with a verification screenshot. The zoom scenario even sequences restore steps ('cua do unzoom ... cua do screenshot'). Matches anchor 5's clear sequence with validation and feedback; not 4 because checkpoints are explicit, not implicit.

5 / 5

Progressive Disclosure

The body is a well-sectioned overview (Setup, Workflow, Scenarios, Quick Reference) with the bulk argument syntax correctly split into the real one-level-deep bundle file, clearly signaled at the end: 'See [references/command-reference.md](references/command-reference.md) for full argument syntax' — and that file exists and delivers the promised full command/argument reference. Easy navigation, no nested references — anchor 5.

5 / 5

Total

19

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with concrete, comprehensive action coverage, natural trigger terms, and an explicit 'Use when' clause. Its only flaws are the second-person voice (which costs it specificity) and slight trigger overlap with screenshot/web-testing skills.

Suggestions

Rewrite the opening in third person (e.g., 'Use when a task requires visually interacting with a GUI: ...') to avoid the second-person penalty on specificity.

Qualify 'take screenshots' with the GUI-automation context (e.g., 'take screenshots of a live desktop') to reduce overlap with screenshot-annotation skills.

DimensionReasoningScore

Specificity

Lists seven-plus concrete actions ('test buttons, fill forms, verify visual layouts, fuzz web pages, automate user flows, take screenshots, or perform end-to-end QA') plus supported environments and the install command, which is comprehensive (anchor 5); however, the second-person phrasing 'Use when you need to visually interact with a GUI' incurs the rubric's 1-point voice penalty, dropping it to 4. It is not a 3 because the action coverage goes well beyond 1-2 actions.

4 / 5

Completeness

Explicitly answers 'when' ('Use when you need to visually interact with a GUI') and 'what' (the enumerated concrete actions) with concrete trigger phrases, and adds scope ('Works on cloud VMs, Docker containers, local machines, and sandboxes') and the dependency ('Needs the `cua` CLI'). Matches anchor 5 exactly; not a 4 because neither what nor when is vague or implicit.

5 / 5

Trigger Term Quality

Natural user phrasings are comprehensively covered — 'test buttons', 'fill forms', 'fuzz web pages', 'automate user flows', 'take screenshots', 'end-to-end QA' — anchored by the domain term 'GUI'. These match what a user would actually say when needing this skill, fitting the anchor-5 comprehensive-coverage example; nothing significant is missing.

5 / 5

Distinctiveness Conflict Risk

Has a clear niche (visual GUI interaction that complements shell/API automation), but 'take screenshots' and 'fuzz web pages' have minor overlap risk with screenshot-annotation and web-testing skills. Mostly distinct with minor overlap — anchor 4; not 5 because a couple of triggers could plausibly activate closely related skills.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

trycua/cua

Path

libs/cua/skills/gui-automation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.