CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/xray-case-management

Author and manage Xray test cases (Jira issues with Test issue type) via the GraphQL + REST APIs - create tests, attach steps, link preconditions, set testType (Manual / Cucumber / Generic), associate with requirements, bulk import via JSON. Covers OAuth client_id/client_secret auth, the GraphQL createTest mutation, the REST /api/v2/import/test/bulk endpoint, and the Cucumber-style scenario authoring path. Use for pre-execution case authoring in Jira-anchored teams using Xray. Distinct from Xray's test-execution / test-run features which post results.

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

80%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, mostly executable reference for Xray Cloud test-case authoring with strong conciseness and actionability. Its weaknesses are workflow_clarity and progressive_disclosure: the bulk-import batch path lacks an implemented validate/poll loop, and the lengthy inline API detail would benefit from being split into reference files.

Suggestions

Add an explicit poll-with-backoff loop (with a validation/terminal-state check) to the bulk_import example so the batch workflow has the feedback loop the anti-patterns section already warns against.

Move the detailed GraphQL mutations, REST endpoint specifics, and CI integration into one-level-deep reference files (e.g. references/graphql-mutations.md, references/bulk-import.md) and keep SKILL.md as a concise overview that links to them.

Replace the create_precondition `pass` stub with an executable Jira REST v3 implementation (or explicitly mark it as a sketch to reference) so every code section is copy-paste ready.

DimensionReasoningScore

Conciseness

The body is code-first and lean: minimal targeted prose, no introductory concept lectures about Xray/Jira, and every section earns its place; the only redundancy is the repeated Cloudflare-citation note, which is minor.

3 / 3

Actionability

Most code is fully executable and copy-paste ready (OAuth token exchange, create_manual_test, bulk_import, link_test_to_requirement, feature import, CI sync); the lone stub create_precondition (`pass`) is a small gap that keeps it from being perfectly complete but the dominant character is executable.

3 / 3

Workflow Clarity

Sections are sequenced (auth → create → import → poll), but the bulk-import batch workflow only mentions polling in prose and never implements the poll loop or backoff in the main code; per the guideline, batch operations missing validation/verification steps cap this at 2.

2 / 3

Progressive Disclosure

No bundle files exist and the ~290-line body keeps API-reference detail (mutations, endpoint specifics, CI config, migration table) inline rather than splitting it into one-level-deep reference files, so structure is present but content that should be separate is inline.

2 / 3

Total

10

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A precise, third-person description that names concrete capabilities, explicit 'Use for' triggers, and clear boundaries against sibling Xray/TCM skills. It fully satisfies all four dimensions.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'create tests, attach steps, link preconditions, set testType (Manual / Cucumber / Generic), associate with requirements, bulk import via JSON' — matching the score-3 anchor for several specific concrete actions.

3 / 3

Completeness

Answers both what (author/manage test cases with the listed actions) and when via an explicit 'Use for pre-execution case authoring in Jira-anchored teams using Xray' clause, matching the score-3 anchor.

3 / 3

Trigger Term Quality

Natural domain terms a user would say are well covered ('Xray test cases', 'Cucumber', 'bulk import', 'preconditions', 'Jira'), and the technical API specifics add precision without crowding out the natural triggers.

3 / 3

Distinctiveness Conflict Risk

Clear niche with explicit disambiguation ('Distinct from Xray's test-execution / test-run features which post results') and named sibling skills, so it is unlikely to trigger for the wrong skill.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents