CtrlK
BlogDocsLog inGet started
Tessl Logo

qa-scout

Browser QA of a PR against a running Twenty app, post-merge on main or pre-merge via the qa-scout label. Derives user-visible scenarios from the PR diff, executes them with the Playwright MCP browser, attests database effects over SQL, watches server and worker logs for swallowed errors, and writes a structured verdict plus a report. Invoked by ci-e2e-main.yaml after the deterministic e2e suite; also runnable locally against a dev stack.

71

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is highly actionable with a clearly sequenced, well-validated workflow and clean section structure. The main room for improvement is trimming narrative/motivational prose to tighten token efficiency, and optionally splitting the verdict/report contract into a reference file.

Suggestions

Tighten the opening and the "2.35 searchVector incident" anecdote into a one-line failure-mode statement to recover tokens without losing the lesson.

Consider moving the verdict.json schema and report.md format into a references file (e.g. verdict-contract.md) to keep the main body as an overview pointing to detail.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence (no explaining what a browser or SQL is), with concrete commands and paths throughout; not 5 because narrative flourishes like the "2.35 searchVector incident" anecdote and the opening persona framing add tokens that could be trimmed, not 3 because it is largely lean and purposeful.

4 / 5

Actionability

Provides fully executable guidance — an inputs path table, exact shell commands (wc -l, tail -n +<offset+1>, grep patterns, psql, jq), a step-by-step login flow, screenshot naming, and a concrete verdict.json schema plus report.md format; the absence of literal Playwright tool calls is justified by a dynamic UI.

5 / 5

Workflow Clarity

The six-step Procedure is clearly sequenced with explicit validation checkpoints (mark log offsets first, sanity-check app boot, verify timeline after writes, read the log window after each scenario) and a feedback loop via the in-progress/final verdict contract; not 4 because checkpoints and error-recovery are thorough.

5 / 5

Progressive Disclosure

Well-organized into clear sections (Inputs, Procedure, Verdict contract, Hard rules, Running locally) with no nested references and no bundle files to misroute; not 5 because the skill exceeds 50 lines so the simple-skill exception does not apply and inline content like the verdict schema could conceivably live in a reference file, not 3 because structure is genuinely good and nothing is buried.

4 / 5

Total

18

/

20

Passed

Description

85%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, complete, and highly distinctive, clearly stating both capabilities and invocation conditions. Its only weakness is trigger-term naturalness: the phrasing is CI/technical and lacks the plain user-facing synonyms a person might say.

Suggestions

Add a plain-language trigger phrase such as "Use when testing or QA-ing a PR in the browser" so it matches how a user would phrase the request.

Include common synonyms (e.g. "test", "QA", "regression-check a PR") alongside the CI-specific terms to broaden natural trigger coverage.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions — "Derives user-visible scenarios from the PR diff, executes them with the Playwright MCP browser, attests database effects over SQL, watches server and worker logs for swallowed errors, and writes a structured verdict plus a report" — with comprehensive coverage; not 4 because no meaningful coverage gaps.

5 / 5

Completeness

Explicitly answers both what (derives scenarios, executes in browser, attests DB effects, watches logs, writes verdict+report) and when ("post-merge on main or pre-merge via the qa-scout label", "Invoked by ci-e2e-main.yaml after the deterministic e2e suite; also runnable locally") with concrete trigger phrases; the equivalent explicit trigger guidance avoids the cap at 3.

5 / 5

Trigger Term Quality

Relevant domain keywords appear ("Browser QA of a PR", "Playwright MCP", "Twenty app") but the phrasing leans on CI/technical jargon and omits common user-facing synonyms like "test a PR" or "QA this change"; not 4 because natural-term coverage is thin, not 2 because it is more than generic.

3 / 5

Distinctiveness Conflict Risk

Clear niche — QA of a PR against the Twenty app with log-watching for swallowed errors and SQL attestation — with distinct triggers and minimal overlap with other skills; not 4 because conflict risk is genuinely minimal.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
twentyhq/twenty
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.