CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

fix-local-tests

Fix failing tests by prioritising shell implementation fixes to match bash behaviour

58

Quality

73%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/fix-local-tests/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a strong, execution-ready skill: every step is backed by runnable commands, ground-truth determination is systematically addressed, and verification is built into multiple checkpoints including a repeat-loop for regressions. The main defects are cosmetic — duplicate "step 7" numbering — plus a description-level weakness (no 'when to use' clause) that the body cannot compensate for.

Suggestions

Fix the duplicate step numbering: there are two "### 7." sections ("Verify all fixes" and "Run bash comparison tests"); renumber to 7 and 8.

Consider merging the two trailing verification steps or adding a one-line final checklist (full suite passes + bash comparison tests pass) to consolidate the ending.

The security preamble could be tightened to 2–3 lines while keeping the untrusted-data rule intact.

DimensionReasoningScore

Conciseness

The body is command-dense with almost no conceptual explanation (no "what a shell is", no library tutorials); each step states its intent in one line plus a runnable command. It is not level 5 because the six-line security blockquote and some parenthetical asides ("e.g. sandbox restrictions, blocked commands", "For quick checks on macOS/Linux") add tokens that could be tightened. It is well above level 3, where noticeable padding would appear.

4 / 5

Actionability

Every step gives copy-paste-ready commands: "go test -race ./interp/... ./tests/... -run \"$ARGUMENTS\" -v 2>&1 | head -200", "docker run --rm debian:bookworm-slim bash -c '<the script from the failing test>'", and even the exact fuzz corpus file format with its destination path "interp/builtins/tests/<pkg>/testdata/fuzz/<FuzzFuncName>/<hash>". This matches the 'fully executable; copy-paste ready; covers the common cases' anchor; there are no gaps that would drop it to 4.

5 / 5

Workflow Clarity

The eight-step sequence is well ordered (reproduce → determine bash ground truth → classify → fix → verify) with per-fix verification in step 4, suite-wide verification in step 7, and an explicit feedback loop ("If new failures appear, repeat from step 1 for those failures") that would merit a 5. However, there are two sections numbered "### 7." ("Verify all fixes" and "Run bash comparison tests"), a genuine editorial defect that muddles the step sequence — a minor gap consistent with level 4 rather than the fully clean level 5.

4 / 5

Progressive Disclosure

No bundle files exist (references/, scripts/, assets/ are absent), and none are needed: the content is a single linear workflow, not reference material that should be split out. Section headers (Workflow, numbered steps, classification table) make navigation easy, matching level 4's 'good structure; most content appropriately placed'. It does not reach level 5 because the under-50-lines simple-skill exception does not apply to this ~130-line body, and no navigational aids (TOC or overview of steps) are provided; it stays above level 3 because nothing that belongs in a separate file is inlined.

4 / 5

Total

17

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description communicates a concrete and appropriately opinionated 'what' (implementation is presumed wrong before the test), but it has no 'when to use' trigger clause and sparse natural trigger vocabulary. It is functional but below the quality bar of the good examples, which all pair capabilities with an explicit 'Use when...' sentence.

Suggestions

Add an explicit trigger clause, e.g. "Use when Go tests in interp/ or tests/ are failing, when the user reports a test failure or regression, or when bash comparison tests (RSHELL_BASH_TEST) fail."

Broaden trigger vocabulary with natural synonyms: "test failures", "broken tests", "failing go test", "bash comparison test failures".

Optionally mention the fuzz-test handling and bash-comparison workflow in the description so the 'what' covers the skill's full scope, not just the implementation-first policy.

DimensionReasoningScore

Specificity

"Fix failing tests by prioritising shell implementation fixes to match bash behaviour" names the domain (fixing failing tests) and one concrete action (prioritising implementation fixes to match bash), but stops there — no coverage of the other activities the body actually handles (updating test expectations, fuzz corpus handling). It matches the anchor 'Names domain and 1-2 concrete actions, but not comprehensive' and is not level 4 because several specific actions are missing, nor level 2 because the action given is concrete rather than generic.

3 / 5

Completeness

The "what" is clear (fix failing tests, prioritising implementation over test changes), but there is no "Use when..." or equivalent trigger clause — the judging guidelines explicitly cap completeness at 3 in that case. It is not level 2 because the 'what' is concrete, and not level 4 because 'when' is entirely absent rather than just weakly implied.

3 / 5

Trigger Term Quality

The phrases "failing tests" and "fix" are natural things a user would say, but there are no synonyms or variations ("test failures", "broken tests", "regressions", "go test", "flaky") and "shell implementation fixes to match bash behaviour" is internal jargon a user would not naturally utter. This fits 'Some relevant keywords but missing common variations or synonyms'; it is above level 2 (keywords are relevant, not generic) but below level 4 (several natural terms are missing).

3 / 5

Distinctiveness Conflict Risk

The "match bash behaviour" framing carves out a fairly distinct niche (shell-implementation conformance testing) with minor overlap risk against generic "fix tests" or "run tests" skills, since "Fix failing tests" alone could collide with those. Fits 'Mostly distinct; minor overlap risk with closely related skills'; not level 5 because the opening phrase is generic enough that a plain 'fix my tests' request could route here over a more generic test-fixing skill.

4 / 5

Total

13

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

DataDog/rshell

Path

.claude/skills/fix-local-tests/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.