Content
47%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
The body functions as a marketing-style overview: lean and readable, but it teaches Claude almost nothing actionable beyond installing the skill. The core usage workflow and scenario format are absent, making the skill unusable from SKILL.md alone.
Suggestions
Add a minimal quick-start workflow: a short example YAML scenario, the command to execute it, and what a pass/fail result looks like.
Include a step-by-step sequence for the core loop (author scenario → run via Playwright → interpret failure diagnosis → consult learning DB), with an explicit validation/retry checkpoint on failure.
Bundle the YAML scenario syntax, provider setup (Claude/OpenAI/Gemini/DeepSeek/Ollama), and diagnosis-checklist details as reference files (e.g., references/scenarios.md, references/providers.md) and link them from clearly labeled sections.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is short (~20 lines) with clear sections and no explanation of concepts Claude already knows; it is genuinely token-efficient. It misses 5 only because of a few promotional lines that earn no place — "Built with the help of AI coding tools — and designed to help AI coding tools test better" and "Actively developed by a solo developer at AILoopLab. Feedback welcome!" — which are minor trimmable padding, not the several unnecessary explanations required for level 3 or below. | 4 / 5 |
Actionability | The only executable guidance is the install command "npx skills add ksgisang/awt-skill --skill awt -g"; everything else is a feature list ("YAML scenarios → Playwright", "Structured failure diagnosis with investigation checklists") and external links. There are no example scenarios, no commands to run a test, and no steps for actually using the tool — high-level hints missing the specific steps to execute, matching anchor 2; it is not 1 because one concrete command is present. | 2 / 5 |
Workflow Clarity | At best a rough two-step notion exists ("Your AI designs YAML test scenarios; AWT executes them with Playwright"), but the workflow a user actually needs — author a scenario, run it, interpret failure diagnosis, apply learning-DB fixes — is entirely unsequenced with many gaps and no validation or feedback-loop checkpoints. This fits anchor 2; it is not 1 because the design→execute sequence is at least hinted, and not 3 because no steps are actually listed. | 2 / 5 |
Progressive Disclosure | The body is well-organized into "What works now" and "Links" sections, with clearly signaled one-level-deep pointers to the main repo, skill repo, and cloud demo. It scores 4 rather than 5 because the detailed materials the skill obviously needs (YAML scenario syntax, provider configuration, diagnosis checklists) are not bundled as reference files — the body only points at external GitHub homepages — leaving a minor organization gap. | 4 / 5 |
Total | 12 / 20 Passed |