CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

rstudio-update-copilot

Use when updating the copilot-language-server version in the RStudio repository, e.g. bumping to a new release. This skill is for macOS and Linux only.

5.00x
Quality

86%

Does it follow best practices?

Impact

100%

5.00x

1 of 3 eval scenarios. Add 2 more for a full score.

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary procedural skill: fully executable commands for every phase (branch guard, prerequisites, four-file edits with per-syntax patterns, S3 upload, sandboxed install verification, commit/PR) sequenced with explicit stop-on-failure checkpoints. The only weakness is token overhead from a handful of one-line rationales that restate what Claude already knows.

DimensionReasoningScore

Conciseness

The body is largely lean — project-specific knowledge like 'The section lists only dependencies changed this release cycle' and 'The default tools root (/opt/rstudio-tools/...) requires elevated privileges' earns its place — but a few sentences explain what Claude already knows (e.g. 'The `trap` ensures the temp directory is cleaned up whether the install succeeds or fails', 'The upload script needs working AWS access, and discovering a credential problem after editing files wastes effort'). These are minor instances of over-explanation that could be trimmed, matching the anchor for 4 rather than the every-token-earns-its-place level of 5.

4 / 5

Actionability

Nearly every step is copy-paste ready: `git branch --show-current`, the `aws sts get-caller-identity` prerequisite checks, `COPILOT_VERSION="${1:-<VERSION>}"` with the Windows batch variant `set COPILOT_VERSION=<VERSION>`, and the verification recipe using `RSTUDIO_TOOLS_ROOT="$VERIFY_DIR"` with a mktemp/trap pattern. Only 'verify all four files contain the new version string' and 'open a pull request' lack literal commands, yet both are fully specified — this matches the fully-executable, common-cases-covered anchor.

5 / 5

Workflow Clarity

Eight clearly numbered, well-sequenced steps with explicit validation checkpoints throughout: 'If the output is not `main`, **stop immediately**', 'Run these checks and stop if any fail', 'Confirm exit code 0 and the "Successfully uploaded" message', and 'After editing, verify all four files contain the new version string'. Error recovery is addressed (e.g. configure AWS credentials 'and try again', 'If it fails, report the error and stop'), so the batch four-file edit is properly validated — matching the explicit-validation-with-recovery anchor rather than the minor-gaps level of 4.

5 / 5

Progressive Disclosure

This is a single self-contained linear procedure with no bundle files; nothing here warrants splitting into references or scripts — each per-file edit pattern is only a few lines and is appropriately inline under its own `####` heading. Sections are clearly labeled (### 1–8 plus per-file subsections), making navigation trivial, which matches the appropriately-placed, easy-navigation anchor rather than the minor-organization-gaps level of 4.

5 / 5

Total

19

/

20

Passed

Description

73%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A solid description with an explicit 'Use when...' trigger, a highly specific niche, and a useful platform boundary. Its main weakness is understating scope: the skill performs uploads, verification, and PR creation, none of which appear in the description, leaving specificity and the 'what' half of completeness weaker than the body deserves.

Suggestions

State the full scope of the skill in the description — e.g. 'Updates the pinned copilot-language-server version across four files, uploads the release to S3, verifies the install, and opens a PR' — to raise specificity from one action to several concrete actions.

Add natural trigger variations users might say, such as 'upgrade copilot-language-server' or a concrete version example (e.g. 'e.g. bumping to 1.459.0'), to broaden keyword coverage.

DimensionReasoningScore

Specificity

It names the domain precisely ('updating the copilot-language-server version in the RStudio repository') and one concrete action ('bumping to a new release'), but omits the skill's other actions — S3 upload, install verification, PR creation. This matches 'names domain and 1-2 concrete actions, but not comprehensive'; it is not 4 because several specific actions are missing, and not 2 because the domain and action are concrete rather than generic.

3 / 5

Completeness

The 'when' is explicit and concrete ('Use when updating the copilot-language-server version in the RStudio repository'), satisfying the trigger-guideline requirement. The 'what' is present but only implied through the trigger clause — the actual work (update pinned version across files, upload to S3, verify, open PR) is not stated — so it sits at 'has both what and when' with the what less explicit than the 5 anchor's separate, concrete statement.

4 / 5

Trigger Term Quality

'updating the copilot-language-server version' and 'bumping to a new release' are phrases a user would naturally say when needing this skill. Coverage is good but misses common variations such as 'upgrade copilot' or a concrete version-number example, so it fits 'good keyword coverage; a few natural terms missing' rather than the comprehensive synonym coverage of 5.

4 / 5

Distinctiveness Conflict Risk

'copilot-language-server version in the RStudio repository' is a narrow, unambiguous niche, reinforced by the explicit platform boundary 'This skill is for macOS and Linux only.' No plausible competing skill would trigger on this description, matching the clear-niche, minimal-conflict anchor.

5 / 5

Total

16

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

rstudio/rstudio

Path

.claude/skills/rstudio-update-copilot/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.