CtrlK
BlogDocsLog inGet started
Tessl Logo

jit-regression-test

Extract a standalone JIT regression test case from a given GitHub issue and save it under a JIT regression runner folder. USE FOR: creating JIT regression tests, extracting repro code from dotnet/runtime issues, "write a test for this JIT bug", "create a regression test for issue #NNNNN", converting issue repro to xunit test. DO NOT USE FOR: non-JIT tests (use standard test patterns), debugging JIT issues without a known repro, performance benchmarks (use performance-benchmark skill).

73

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

—

The risk profile of this skill

SKILL.md
Quality
Evals
Security

Quality

Content

80%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable and well-structured with concrete, copy-paste-ready examples. Its main weakness is the absence of a verification step to confirm the created test actually reproduces the target JIT bug.

Suggestions

Add a final step instructing Claude to build and run the test against the buggy build to confirm it reproduces the failure, then against the fixed build to confirm it passes.

Consolidate the placeholder skeleton and the Runtime_99391 example, or mark the skeleton as optional, to reduce overlap and save tokens.

Trim the 'Key Conventions' list to only conventions not already evident from the inline examples.

DimensionReasoningScore

Conciseness

Mostly lean and efficient, but the placeholder skeleton example and the full Runtime_99391 example overlap, and the 'Key Conventions' list restates what the examples already show — minor trimmable redundancy.

4 / 5

Actionability

Provides exact file paths, copy-paste-ready C# with license header, a concrete real example, and a complete .csproj XML with CLRTestEnvironmentVariable — fully executable guidance covering the common cases.

5 / 5

Workflow Clarity

Steps are clearly sequenced (gather → locate → create → csproj) with a pre-flight guard, but there is no validation checkpoint confirming the test compiles or actually reproduces the bug — a significant gap for regression testing.

3 / 5

Progressive Disclosure

No bundle files exist, and the body is a self-contained, well-sectioned overview with no nested references and no bulk content misplaced where a separate file would serve better.

5 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is third-person, concrete, and trigger-rich, with explicit use-case boundaries that distinguish it from adjacent skills. It exemplifies both the 'what' and 'when' without padding.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Extract a standalone JIT regression test case', 'save it under a JIT regression runner folder', 'extracting repro code', 'converting issue repro to xunit test' — covering the task comprehensively.

5 / 5

Completeness

Explicitly answers 'what' (extract and save a JIT regression test) and 'when' via a 'USE FOR:' clause with concrete triggers plus a 'DO NOT USE FOR:' boundary, satisfying both requirements clearly.

5 / 5

Trigger Term Quality

Includes natural user phrasings and synonyms such as 'write a test for this JIT bug', 'create a regression test for issue #NNNNN', and 'converting issue repro to xunit test', matching what a user would actually say.

5 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (JIT regression tests for dotnet/runtime) and the 'DO NOT USE FOR' clause explicitly steers away from non-JIT tests and performance benchmarks, minimizing conflict risk.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
dotnet/runtime
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.