alfworld-device-operator

Operates a device or appliance (like a desklamp, microwave, or fridge) to interact with another object. Use when the task requires using a tool on a target item (e.g., "look at laptop under the desklamp", "heat potato with microwave"). Locates both the device and target object, co-locates them, and executes the appropriate use action (toggle, heat, cool, or clean).

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Passed

No findings from the security scan

Quality

Content

68%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, actionable skill with clear phased guidance and a useful single reference file. Its main weakness is workflow_clarity: it lacks an explicit validation checkpoint before the final device operation and contains a small inconsistency between the Phase 4 action format and the worked example.

Suggestions

Add an explicit validation checkpoint in Phase 4 (e.g., verify the object is in inventory and you are co-located with the device before executing the use action), with a retry loop if 'Nothing happened'.

Reconcile the action format: Phase 4 specifies `toggle {device} {recep}` for a desklamp but the example uses `use desklamp 1`; align these so the instruction and example match.

Tighten redundant phrasing such as restating the co-location rule in both Phase 3 and section 3 to improve token efficiency.

Dimension	Reasoning	Score
Conciseness	Mostly efficient with well-organized phases and minimal padding, though phrasing like 'The specific action is determined by the device-object pair' and restated co-location rules add minor redundancy that could be trimmed.	4 / 5
Actionability	Provides concrete, executable ALFWorld actions (`go to {recep}`, `take {obj} from {recep}`, `heat {obj} with {device}`) plus a full worked example, with only minor gaps such as the `toggle {device} {recep}` vs `use desklamp 1` inconsistency between Phase 4 and the example.	4 / 5
Workflow Clarity	Steps are clearly sequenced into four phases with an error-recovery hint ('Nothing happened' -> re-evaluate), but the workflow lacks an explicit validation checkpoint confirming co-location/object-in-hand before the final use action, leaving a gap for a multi-step interactive operation.	3 / 5
Progressive Disclosure	Good structure with a concise overview body split into clear sections plus a real one-level reference (`device_location_guide.md`) that is relevant and not deeply nested; only minor organization gaps remain.	4 / 5
	Total	15 / 20 Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description with explicit trigger phrases and a clear what/when structure tailored to its ALFWorld domain. Trigger-term coverage is the only slightly weaker area, limited by the domain's narrow vocabulary.

Dimension	Reasoning	Score
Specificity	Lists multiple concrete actions ('Locates both the device and target object, co-locates them, and executes the appropriate use action (toggle, heat, cool, or clean)') with comprehensive coverage of the device-operation verbs.	5 / 5
Completeness	Clearly answers 'what' (operates a device to interact with a target object, co-locates and executes a use action) and 'when' ('Use when the task requires using a tool on a target item') with concrete trigger phrases.	5 / 5
Trigger Term Quality	Includes concrete natural trigger phrases ('look at laptop under the desklamp', 'heat potato with microwave') users would actually say, though file-extension or synonym-style coverage is limited because the domain (ALFWorld tasks) lacks natural synonyms beyond the example phrasings.	4 / 5
Distinctiveness Conflict Risk	Targets a very specific ALFWorld niche (device-on-target operations: toggle/heat/cool/clean) with distinct trigger phrasings, so it is unlikely to fire for unrelated skills.	5 / 5
	Total	19 / 20 Passed

Validation

100%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository: zjunlp/SkillNet
Path: experiments/src/skills/alfworld/alfworld-device-operator/SKILL.md
Commit: cce11c3

Reviewed: 2 days ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.