CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

computer-use

构建 GUI 自动化 Agent、让 Agent 像人一样看屏幕并用鼠标键盘操作桌面或浏览器软件时使用。 覆盖感知-思考-行动循环、动作空间(GUI/bash/文件编辑)、视觉定位 Grounding 三条路线 (结构化元素索引、Set-of-Mark、纯坐标预测)、分辨率坐标缩放、关键帧观察接口、世界模型与移动端生态壁垒。 触发词:Computer Use、GUI 自动化、截图、Grounding、browser-use、Set-of-Mark、视觉定位、坐标缩放、OSWorld。

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-sectioned, knowledge-dense guide for building GUI automation agents with genuinely specific guidance (grounding route selection criteria, a worked coordinate-scaling example, safety boundaries, and an explicit recovery strategy). Its main weaknesses are the broken bundle references — all cited companion paths are absent from the skill directory — plus a step-numbering error and minor tangential passages that could be trimmed.

Suggestions

Fix the numbering error in '实践模式' where two consecutive items are both labeled '6' (增强观察接口 and 移动端适配), which breaks the 8-step sequence.

Resolve the dangling references: either include the referenced companion material (chapter6/ directories, book/chapter6.md, validation/) in the skill bundle or clearly mark them as external repository paths not shipped with the skill.

Trim tangential passages — the speech/robotics timing comparison and the ad-monetization explanation — to improve token efficiency without losing operational guidance.

DimensionReasoningScore

Conciseness

The body is dense with non-obvious domain guidance (grounding route selection, aspect-ratio coordinate scaling, keyframe observation) and mostly avoids padding. Minor over-explanation could be trimmed, e.g. the speech/robotics timing comparison in '循环节奏与尺度' and the ad-monetization digression in '生态壁垒'. Not 5: these tangential passages cost tokens without adding operational guidance; not 3: nearly every line carries skill-specific knowledge rather than concepts Claude already knows.

4 / 5

Actionability

Concrete guidance is present: the four-step browser-use flow ('CDP 取 DOM → 检测可交互元素 → 标注唯一 ID 并在截图绘边界框 → 同步生成…文本列表') and a numeric scaling example ('2560×1440 的 16:9 屏幕选 FWXGA 1366×768,模型返回 (683,384) 反推真实坐标约 (1280,720)'). Not 5: there is no executable code in the body itself, and steps like '实现坐标缩放层:枚举目标模型支持的分辨率档位' remain high-level; not 3: the guidance goes well beyond vague direction with specific procedures and worked numbers.

4 / 5

Workflow Clarity

'实践模式' provides a clear 8-step build sequence with validation checkpoints ('验收要测量效率…记录真实运行证据', '保留每步截图与动作轨迹,便于回放和验收') and an explicit error-recovery loop ('恢复策略要预置'). Not 5: the numbered list contains a numbering error (two items labeled '6'), and several steps are parallel topic areas rather than a strictly checkpointed sequence; not 3: validation and feedback loops for the risky (irreversible-operation) parts are explicitly present.

4 / 5

Progressive Disclosure

Sections are well-organized (何时使用 / 核心原则 / 实践模式 / 常见陷阱 / 配套代码 / 深度阅读) with dedicated pointer sections, but every referenced path — 'chapter6/claude-computer-use-native/', 'chapter6/computer-use-open-model/', 'book/chapter6.md', and the 'validation/ 目录' — does not exist in the skill bundle (no references/, scripts/, or assets/ directories are present). Not 4: navigation to the referenced material is broken within the bundle; not 2: the SKILL.md itself is appropriately structured and the pointers are clearly signaled.

3 / 5

Total

15

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it explicitly states what the skill covers with a comprehensive, concrete enumeration of capabilities, provides an explicit use-when clause, and lists nine natural trigger terms in both Chinese and English. The only weakness is the somewhat generic trigger '截图', which carries minor conflict risk with image-related skills.

DimensionReasoningScore

Specificity

The description enumerates concrete, specific capabilities: '感知-思考-行动循环、动作空间(GUI/bash/文件编辑)、视觉定位 Grounding 三条路线(结构化元素索引、Set-of-Mark、纯坐标预测)、分辨率坐标缩放、关键帧观察接口、世界模型与移动端生态壁垒' — multiple specific items with comprehensive domain coverage. Not 4: there are no meaningful coverage gaps in the capability list.

5 / 5

Completeness

Both 'what' (the enumerated coverage list) and 'when' ('构建 GUI 自动化 Agent…时使用' plus an explicit 触发词 list) are clearly and explicitly stated with concrete trigger phrases. Not 4: the 'when' clause is fully explicit, not merely present.

5 / 5

Trigger Term Quality

Nine explicit trigger terms ('Computer Use、GUI 自动化、截图、Grounding、browser-use、Set-of-Mark、视觉定位、坐标缩放、OSWorld') cover natural user phrasing across both Chinese and English, including framework and benchmark names plus synonyms (视觉定位/Grounding). Not 4: coverage is comprehensive rather than merely good.

5 / 5

Distinctiveness Conflict Risk

The niche (GUI automation agents / computer use) is clear and mostly distinct, but the generic trigger '截图' (screenshot) could overlap with image-analysis or screen-capture-adjacent skills. Not 5: minor overlap risk from this broad term; not 3: the domain is far more specific than a generic 'works with X files' skill.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

bojieli/ai-agent-book

Path

skills/computer-use/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.