CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

verify-agent-tty

Drive the real agent-tty CLI built from this checkout, the way a user or agent does, and capture proof - JSON envelopes, rendered snapshots, PNG screenshots, recordings, and the session files on disk - in an isolated Home that never touches ~/.agent-tty. Use it to verify a change to any agent-tty command (create, run, wait, batch, mouse, snapshot, screenshot, record, gc, dashboard) end to end before you call it done, or to reproduce a reported CLI or TUI bug.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An operationally excellent skill body with fully executable commands, explicit validation loops, and strong safety handling around isolation and teardown. Its weaknesses are the bloated Cleanup section, which buries operator-relevant rules in script-internals detail that belongs in a reference file, and reliance on a features/ map that is not part of the bundle.

Suggestions

Split the Cleanup section: keep a short operator checklist (run after every run; exit 1 means stop the listed processes and rerun; do not pipe its output from inside the run folder) in SKILL.md, and move the scan internals (setuid/environ limits, pid namespaces, birth-time heuristics, docker pid 1) into a reference file such as references/cleanup-details.md.

Trim the HISTFILE digression in the env.sh paragraph to the one actionable rule (`att create --env HISTFILE=<path> -- bash --noprofile --norc`) and drop the multi-sentence explanation of bashrc ordering.

Ship the `features/` map (or at least README.md and dashboard.md) as part of the skill bundle, or inline a one-line-per-feature summary, so the 'Read it before you drive anything' instruction resolves for a reader of the skill alone.

DimensionReasoningScore

Conciseness

The Launch, Doctor, Drive, Evidence, and Helpers sections are dense and efficient ("Wait on what the screen shows with `att wait`, never `sleep"), but the Cleanup section is a ~450-word single paragraph enumerating edge cases (setuid programs, `prctl(PR_SET_DUMPABLE, 0)`, pid namespaces, folder birth times) that read as internal documentation of the script rather than operator guidance. This sits at the 3 anchor ('mostly efficient but includes some unnecessary explanation or could be tightened') rather than 2, because the detail is project-specific and non-obvious rather than concepts Claude already knows.

3 / 5

Actionability

Fully executable, copy-paste-ready guidance throughout: `ENV=$(.agents/skills/verify-agent-tty/scripts/start-run.sh <name>)`, `att create --json -- <argv>`, `node --import tsx test/fixtures/apps/<app>/main.ts`, exact envelope fields, concrete fixture behavior ("prints `READY> `, answers each line with `ECHO: <line>`"), and documented exit codes. This matches the 5 anchor ('fully executable; copy-paste ready code or commands; specific examples cover the common cases').

5 / 5

Workflow Clarity

The sequence Launch -> Doctor -> Drive -> Evidence -> Cleanup is explicit, with validation checkpoints and feedback loops exactly where risk lives: "Run this first, and again whenever a result looks wrong" (doctor), "Rebuild with a new `start-run.sh` after every change to `src/`", "Check the files, not the flag name", and cleanup failure recovery ("Stop them yourself (`kill <pid>`) ... then run `cleanup.sh` again"). Destructive teardown and batch gc operations all carry validation, matching the 5 anchor.

5 / 5

Progressive Disclosure

Structure is present (clear sections, a helpers table, and a one-level-deep pointer to the feature map: "The feature map in `features/README.md` ... Read it before you drive anything"), but two referenced files (`features/README.md`, `features/dashboard.md`) are not present in the provided bundle, and the Cleanup mega-paragraph is inlined material that clearly belongs in a separate reference file. This fits the 3 anchor ('some structure but could be better organized; references present but not clearly signaled') better than 4, since a reader cannot verify the primary reference target exists.

3 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description in third-person imperative voice that states concrete capabilities, an explicit 'Use it to ...' trigger clause, and a highly distinctive project-specific scope. The only minor gap is limited synonym coverage (e.g., 'test') beyond the exact command names.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions with comprehensive coverage: "Drive the real agent-tty CLI", "capture proof - JSON envelopes, rendered snapshots, PNG screenshots, recordings, and the session files on disk", and enumerates every command it covers ("create, run, wait, batch, mouse, snapshot, screenshot, record, gc, dashboard"). It matches the 5-anchor ('lists multiple specific concrete actions; comprehensive coverage') and nothing is missing that the 4-anchor would suggest.

5 / 5

Completeness

It explicitly answers both questions: what ("Drive the real agent-tty CLI ... and capture proof - JSON envelopes, rendered snapshots, PNG screenshots, recordings, and the session files on disk") and when ("Use it to verify a change to any agent-tty command ... before you call it done, or to reproduce a reported CLI or TUI bug") with concrete trigger phrasing, matching the 5 anchor exactly.

5 / 5

Trigger Term Quality

Good natural-term coverage: "verify a change ... end to end before you call it done", "reproduce a reported CLI or TUI bug", plus every command name a user would mention. It falls just short of the 5 anchor because common synonyms like "test" are absent and the coverage relies heavily on the exact command list rather than varied phrasings.

4 / 5

Distinctiveness Conflict Risk

It carves out a clear niche: "the real agent-tty CLI built from this checkout", "an isolated Home that never touches ~/.agent-tty", and a project-specific command list, so it would not trigger for any other skill. This is the 5 anchor ('clear niche with distinct triggers; minimal conflict risk').

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 1 missing

Warning

Total

15

/

16

Passed

Repository

coder/agent-tty

Path

.agents/skills/verify-agent-tty/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.