Content
100%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
An exemplary SKILL.md body: every sentence adds non-obvious, repo-specific knowledge (APIs, event names, settings keys, arm-parity pitfalls) with zero padding, concrete copy-paste-ready code, a clear decision workflow with an explicit validation step, and clean single-file organization with one well-signaled source reference. No dimension shows a gap worth penalizing.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Lean and dense throughout: every token carries repo-specific knowledge Claude cannot infer — 'experiment: { mode: 'auto' }', 'IWorkbenchAssignmentService.getTreatment<T>(name)', 'experiments.override.<treatment name>', 'monacoworkbench/experimentTrigger', the once-per-window semantics, the agent-host forwarding caveat. No general concepts (what A/B testing is, how telemetry works) are re-explained, and the one rationale sentence ('Dilution only costs statistical power, while a biased trigger gives wrong results') directly justifies the decision rules that follow, so it earns its place. | 5 / 5 |
Actionability | Fully concrete, executable guidance: exact schema properties to add, exact API calls with generic types, an exact user-settings override string, named helper functions with copy-paste-ready call signatures ('logSettingExperimentTrigger(telemetryService, MY_SETTING_ID)'), a correctly-ordered code example, named test service 'TestExperimentTriggerTelemetryService', and named code anchors (experimentTrigger.ts, AgentHostGitStateService, chat.agentMerge.enabled). This matches the level-5 anchor for an instruction skill with concrete, specific guidance throughout. | 5 / 5 |
Workflow Clarity | The processes are clearly sequenced with explicit checkpoints: choose the control mechanism (setting vs. treatment, with the decision criterion 'users could reasonably choose the behavior themselves'), decide whether a trigger applies (concrete in/out cases), fire it with a decision table plus an annotated code example showing arm-independent ordering, then validate — 'Test each trigger in every arm with TestExperimentTriggerTelemetryService'. The pitfalls list ('Find every place where the setting or treatment changes behavior') acts as a checklist, and 'start a new experiment iteration' after moving a trigger is corrective guidance, matching the level-5 anchor. | 5 / 5 |
Progressive Disclosure | The skill is self-contained at ~63 lines with no bundle files, well-organized under clear sections ('Controlling behavior', 'Trigger events', 'When to use one', 'When to fire it'), and its single reference — the source-file link to experimentTrigger.ts — is well-signaled and one level deep. Nothing is inlined that clearly belongs in a separate file at this scale, so navigation is easy and content placement is appropriate, matching the level-5 anchor. | 5 / 5 |
Total | 20 / 20 Passed |