CtrlK
BlogDocsLog inGet started
Tessl Logo

tidb-test-diff-triage

Triage unexpected TiDB test diffs that seem unrelated to the current PR. Use when plan/result/testdata changes appear after merge/rebase or only in specific local runs, especially to quickly rule in/out failpoint enablement issues.

89

1.39x
Quality

85%

Does it follow best practices?

Impact

95%

1.39x

Average score across 3 eval scenarios

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A tight, actionable triage workflow that respects token budget and sequences steps with sensible gating. Main gap is that the failpoint-enabled run command and the testdata-update retry loop are referenced implicitly rather than given as explicit executable steps.

Suggestions

Spell out the failpoint-enabled go test command inline (e.g. the exact `go test -tags=... -failpoint` invocation) instead of referring to it only as 'Failpoint-enabled run'.

Add an explicit validate->fix->retry loop for testdata updates (re-run the target test after syncing expected outputs and revert if the diff reappears).

Mark the docs/agents/testing-flow.md reference as a repo-relative path so it is unambiguous it is not a bundle file.

DimensionReasoningScore

Conciseness

Lean and efficient throughout; assumes Claude's competence, never explains what TiDB/failpoints are, and every line (e.g. '-tags=intest,deadlock does not enable failpoints') earns its place.

5 / 5

Actionability

Provides concrete executable commands ('git bisect start', '-run <TestName> -count=1') and a pointed external reference, but the failpoint-enabled go test invocation is named only by a label rather than spelled out.

4 / 5

Workflow Clarity

Clear three-rule sequence with a gate ('Do not record/update testdata before root cause is identified') and a bisect procedure, but the validate->fix->retry feedback loop for the destructive testdata update is implicit rather than explicit.

4 / 5

Progressive Disclosure

Well-organized sections under 50 lines with a clearly signaled one-level reference (docs/agents/testing-flow.md); no bundle files exist to verify, and the lone external reference is cleanly signaled rather than nested.

4 / 5

Total

17

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A well-crafted description that clearly states the skill's purpose and gives concrete, natural trigger conditions in third person. It is specific and distinct with only minor keyword-coverage gaps.

DimensionReasoningScore

Specificity

Names the domain ('unexpected TiDB test diffs') and concrete actions ('Triage', 'rule in/out failpoint enablement issues'), with several specific actions but slight coverage gaps around the bisect/testdata-sync steps that live only in the body.

4 / 5

Completeness

Explicitly answers both what ('Triage unexpected TiDB test diffs...') and when via a concrete 'Use when plan/result/testdata changes appear after merge/rebase...' clause.

5 / 5

Trigger Term Quality

Includes natural trigger phrases a TiDB engineer would say ('test diffs', 'plan/result/testdata changes', 'merge/rebase', 'local runs', 'failpoint'), though a few common synonyms are absent.

4 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (TiDB test-diff triage, failpoint enablement) with distinct triggers and minimal overlap risk with other skills.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
pingcap/tidb
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.