CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

computer-use-agents

Build AI agents that interact with computers like humans do - viewing screens, moving cursors, clicking buttons, and typing text. Covers Anthropic's Computer Use, OpenAI's Operator/CUA, and open-source alternatives. Critical focus on sandboxing, security, and handling the unique challenges of vision-based control. Use when: computer use, desktop automation agent, screen control AI, vision-based agent, GUI automation.

58

Quality

73%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./cli-tool/components/skills/ai-research/computer-use-agents/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

46%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body chooses the right topics (action loop, sandboxing, official tool usage) and contains genuinely useful security configuration, but it is structurally damaged: three code blocks are cut off mid-line, the Sharp Edges table is broken (every row reads "Issue | <severity> | ## ..." with no actual issue text), and no step-by-step workflow with validation exists. It currently functions more as a fragmentary reference than an executable skill.

Suggestions

Complete the truncated code blocks (the pyautogui agent cut off at "scrolled {dir", the sandbox wrapper at "from dataclasses im", and the Anthropic implementation's screenshot handler) and include the missing _handle_bash/_handle_editor methods or reference files containing them.

Rebuild the Sharp Edges table: every row currently has the literal placeholder "Issue" in the issue column and a section heading pasted into the solution column, so the table conveys no actual guidance.

Move the Dockerfile, docker-compose.yml, and full implementation code into reference files (with the missing requirements.txt and supervisord.conf) and keep SKILL.md as a concise overview with one-level-deep links.

Add an ordered build-and-deploy workflow with validation checkpoints (e.g., verify the sandbox blocks network/credentials before letting the agent act), since this skill governs agents that control live computers.

DimensionReasoningScore

Conciseness

Most of the body is dense, useful code and checklist content, but it includes padding Claude does not need: the basic explanation of the Perception-Reasoning-Action loop, the marketing quote "Claude Opus 4.5 is now the 'best model in the world for computer use'", and inline time-sensitive version numbers ("computer_20251124", "claude-sonnet-4-20250514") that are not isolated in a deprecated/old-patterns section. It is not a 4 because these unnecessary explanations and stale version chatter are more than minor trimming candidates.

3 / 5

Actionability

There is substantial concrete guidance (pyautogui action dispatch, a Dockerfile, docker-compose with security constraints), but the code is literally truncated mid-string ("f\"scrolled {dir" and "from dataclasses im"), methods referenced are never shown (_handle_bash, _handle_editor), and the Dockerfile depends on files (requirements.txt, supervisord.conf) that are neither provided nor listed. This matches "some concrete guidance but incomplete; missing key details" rather than 4, whose code is executable with only minor gaps.

3 / 5

Workflow Clarity

Sequences exist (the numbered PERCEPTION/REASONING/ACTION/FEEDBACK loop and the five isolation requirements), but there is no end-to-end workflow connecting sandbox setup to agent execution, and validation checkpoints are entirely absent — notable because this skill deploys agents that control real computers, a risky-operation context the rubric caps at 3. It is not a 2 because the pattern sequences themselves are coherent and clearly numbered, and not a 4 because there are no verify/recover steps anywhere and the error-recovery guidance (the Sharp Edges table) is broken.

3 / 5

Progressive Disclosure

No bundle files exist (no references/, scripts/, or assets/ directories), and roughly 200 lines of material that clearly belongs in separate files — a full Dockerfile, a docker-compose.yml, and a long Python implementation — are inlined in SKILL.md. This matches "content that clearly belongs in separate files is inlined"; it is not a 3 because there are no references or navigation to separate material at all, and the one structure present (## Patterns headers) does not offset a monolithic body.

2 / 5

Total

11

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete capability list, explicit "Use when" trigger clause, and a well-defined niche covering multiple provider ecosystems with a security emphasis. The only weakness is trigger coverage that misses a few natural synonyms users might say.

Suggestions

Add one or two common natural variations to the trigger list, e.g. "UI automation" or "browser/desktop agent", since "screen control AI" is unlikely phrasing for most users.

Consider phrasing triggers as user-shaped scenarios ("Use when the user wants an agent to operate a GUI on its own") in addition to bare keyword terms.

DimensionReasoningScore

Specificity

The description lists four concrete actions ("viewing screens, moving cursors, clicking buttons, and typing text") plus concrete scope ("Covers Anthropic's Computer Use, OpenAI's Operator/CUA, and open-source alternatives") and named focus areas ("sandboxing, security, ... vision-based control"). This matches the anchor for multiple specific concrete actions with comprehensive coverage; it is not score 4 because coverage extends beyond input actions to security and provider landscape, and not below because no concrete action is missing from the domain.

5 / 5

Completeness

It explicitly answers both questions: the "what" is stated up front ("Build AI agents that interact with computers like humans do - viewing screens, moving cursors, clicking buttons, and typing text") and the "when" is an explicit trigger clause ("Use when: computer use, desktop automation agent, ..."). This matches the anchor for clearly and explicitly answering both with concrete trigger phrases; a 4 would require the "when" to be only weakly implied, which it is not.

5 / 5

Trigger Term Quality

"Use when: computer use, desktop automation agent, screen control AI, vision-based agent, GUI automation" gives good natural-term coverage ("computer use", "GUI automation", "desktop automation"). It falls just short of the comprehensive-with-synonyms anchor: common variations like "UI automation", "browser automation agent", or "RPA" are absent, and "screen control AI" is a phrase few users would naturally type.

4 / 5

Distinctiveness Conflict Risk

Triggers like "computer use", "vision-based agent", and "GUI automation" occupy a clear niche distinct from most skills, matching "mostly distinct; minor overlap risk". It is not a 5 because there is residual overlap risk with adjacent skills (e.g., a browser-automation or web-agent skill would also match "GUI automation" or "screen control AI"), and not a 3 because the vision-based/computer-use framing is specific enough to disambiguate from generic automation skills.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

davila7/claude-code-templates

Path

cli-tool/components/skills/ai-research/computer-use-agents/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.