CtrlK
BlogDocsLog inGet started
Tessl Logo

testrail

Sync tests with TestRail. Use when user mentions "testrail", "test management", "test cases", "test run", "sync test cases", "push results to testrail", or "import from testrail".

64

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./.gemini/skills/testrail/SKILL.md

The canonical home for this skill is testrail in alirezarezvani/claude-skills

SKILL.md
Quality
Evals
Security

Quality

Content

68%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is well-structured, concise, and highly actionable with concrete commands and code. Its main gap is workflow robustness: the batch sync operations lack validation checkpoints and error-recovery loops, which the rubric caps at 3 for workflow clarity.

Suggestions

Add validation checkpoints to the batch workflows — e.g., before pushing results, verify every Playwright test has a TestRail annotation and report unmatched tests; on `testrail_add_result` failure, retry or surface the error rather than silently continuing.

Specify or link the 'appropriate template' referenced in the import flow (step 2) so the mapping from TestRail case to Playwright test is concrete rather than implied.

Tighten the MCP-server-not-registered blockquote to the essential workaround (install command + registration step), moving the issue-number and removal-history detail out of the main flow.

DimensionReasoningScore

Conciseness

The body is lean — concrete commands, a tool table, and copy-paste code with no padding or explanation of what TestRail/Playwright are — but the multi-paragraph blockquote about the MCP server not being auto-registered (issue #978, removal history) could be tightened. This fits score 4 (efficient; minor instances of over-explanation that could be trimmed) better than score 5 (every token earns its place) and well above score 3.

4 / 5

Actionability

It provides executable commands (`/pw:testrail import --project <id> --suite <id>`), a runnable reporter invocation (`npx playwright test --reporter=json > test-results.json`), concrete MCP tool names with status_id values, and copy-paste annotation code. It stops at 4 rather than 5 because a few steps remain vague ("Map to a Playwright test using appropriate template", "Parse results") with the referenced template unspecified, leaving minor gaps.

4 / 5

Workflow Clarity

Each capability has a clear numbered sequence, but the batch operations (import cases, push results, update cases) lack validation checkpoints or error-recovery feedback loops — e.g., no handling for tests missing a TestRail ID, no verify-before-push step, no retry on tool failure. Per the rubric, batch operations without validation cap workflow_clarity at 3; it is above score 2 because the sequences are well-defined, but cannot exceed 3 without checkpoints.

3 / 5

Progressive Disclosure

The skill is self-contained with no bundle files, organized into clear sections (Prerequisites, Capabilities, MCP Tools Used, Test Annotation Format, Output) that make navigation easy. It scores 4 (good structure, content appropriately placed, minor organization gaps) rather than 5 because at ~130 lines the inlined per-capability step lists could arguably be split, and there are no one-level-deep references to signal; it is well above score 3's jumble of inline content.

4 / 5

Total

15

/

20

Passed

Description

85%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is trigger-rich and explicitly pairs a 'what' with a detailed 'when' clause, giving it strong completeness, trigger quality, and distinctiveness. Its only weakness is specificity: the capability statement is a single generic verb, with the concrete actions deferred to the body.

DimensionReasoningScore

Specificity

The description states only one generic action verb — "Sync tests with TestRail" — naming the domain but offering minimal concrete actions; the import/push/run/status/update capabilities live in the body, not the description. It fits the score-2 anchor ("Names the domain but actions are minimal or generic") better than score 3, which requires 1-2 concrete actions, and is clearly above score 1's pure abstraction.

2 / 5

Completeness

It explicitly answers both what ("Sync tests with TestRail") and when ("Use when user mentions ...") with concrete trigger phrases, matching the score-5 anchor. It is not score 4 because the 'when' clause is more explicit and detailed than the score-4 example, and not below because both elements are clearly present.

5 / 5

Trigger Term Quality

It enumerates comprehensive natural trigger phrases users would actually say — "testrail", "test management", "test cases", "test run", "sync test cases", "push results to testrail", "import from testrail" — covering synonyms and verb variations. This matches the score-5 anchor (comprehensive coverage of natural terms including synonyms); no relevant file extensions apply to this domain, so nothing is missing.

5 / 5

Distinctiveness Conflict Risk

It occupies a clear niche (TestRail integration) with distinct, TestRail-specific triggers, giving minimal conflict risk with other skills — matching the score-5 anchor. It is well above score 4 (which still allows minor overlap) since the triggers are unambiguously TestRail-scoped.

5 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
alirezarezvani/claude-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.