CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

rollout-ui

Build or improve UIs for browsing, inspecting, and comparing LLM rollout content, messages, tool calls, and transcripts across models and checkpoints. Use when the user asks for a rollout viewer, trajectory inspector, or accessible transcript diffs. Defer metric-based data and dashboards to Weights & Biases.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, well-sequenced instruction skill with a prescribed stack, real file pointers, and an excellent one-level-deep reference split for browser verification. Its weaknesses are repetitive restatement of the W&B boundary, the absence of any copy-paste-ready code sketches for the adapter or query layers, and no explicit remediation loop when an acceptance check fails.

Suggestions

State the W&B deferral boundary once (in §5) instead of three times across the intro, §2, and §5, trimming roughly a paragraph of repetition.

Add one or two short copy-paste-ready snippets — a minimal FastAPI adapter route and a TanStack Query key pattern including run/split/checkpoint/record identity — to make the data-access guidance fully executable.

Close the loop in §7 with an explicit remediation step: when a browser acceptance check fails, fix the issue and re-run the checklist before hand-off.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence (no library or concept explainers), but the W&B deferral boundary is stated three times (intro, §2, §5) and the "example, not a cookbook API" hedge pattern repeats. These are minor instances of over-explanation that could be trimmed, fitting the 4 anchor; the absence of any padded concept explanation rules out 3.

4 / 5

Actionability

Concrete specifics abound: a named stack table (Blueprint, TanStack Query, FastAPI, Playwright), real cookbook file paths (rollout_logging.py, train.py, *_rollout_summaries.jsonl), an exact route pattern, a compound key tuple, and pixel-level accessibility targets. For an instruction-only skill this is mostly executable guidance, but nothing is copy-paste ready (no adapter route or query-key sketch), keeping it just below the 5 anchor and well above the pseudocode-level 3 anchor.

4 / 5

Workflow Clarity

The seven numbered sections form a coherent build sequence with validation at both ends: acceptance tests agreed in §1 ("acceptance tests" in the implementation brief) and a real browser verification checklist in §7 ("Test a production build as well as development mode", "State which checks were actually run"). It misses the 5 anchor only because no explicit fix-and-re-verify feedback loop is stated for failed checks; this is not a destructive/batch skill so the workflow-clarity cap does not apply.

4 / 5

Progressive Disclosure

The body is a well-organized overview with seven clear sections, and the detailed acceptance procedures are appropriately split into references/browser-checks.md, which exists and is signaled as "[the browser acceptance checklist](references/browser-checks.md)" exactly where needed (§7). The single reference is one level deep and clearly navigable, matching the 5 anchor; there are no organization gaps that would justify 4.

5 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that clearly and concretely states both what the skill does and when to use it, with natural trigger phrases and an explicit scope boundary against metrics dashboards. The only minor gap is a few missing natural synonyms (e.g., "rollout browser").

DimensionReasoningScore

Specificity

"Build or improve UIs for browsing, inspecting, and comparing LLM rollout content, messages, tool calls, and transcripts across models and checkpoints" lists multiple concrete actions (build, improve, browse, inspect, compare) over a comprehensively enumerated object domain. Matches the 5 anchor rather than 4 because action and object coverage is complete, not 'minor gaps'.

5 / 5

Completeness

The first sentence explicitly states what the skill does, and "Use when the user asks for a rollout viewer, trajectory inspector, or accessible transcript diffs" explicitly states when with concrete trigger phrases. This mirrors the 5 anchor's structure; the 'when' is fully explicit, so 4 does not fit.

5 / 5

Trigger Term Quality

"Use when the user asks for a rollout viewer, trajectory inspector, or accessible transcript diffs" provides strong natural trigger phrases for this domain. Not 5 because common synonyms such as "rollout browser" or "compare rollouts across models" are absent; not 3 because the core phrases users would actually say are present and explicit.

4 / 5

Distinctiveness Conflict Risk

The niche (LLM rollout/trajectory evidence browsers) is distinct, and "Defer metric-based data and dashboards to Weights & Biases" actively disambiguates from generic dashboard/visualization skills. Clear niche with distinct triggers and minimal conflict risk, matching the 5 anchor.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 suspicious

Warning

Total

15

/

16

Passed

Repository

thinking-machines-lab/tinker-cookbook

Path

skills/rollout-ui/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.