CtrlK
BlogDocsLog inGet started
Tessl Logo

ultraqa

Adversarial dynamic e2e QA workflow - generate hostile scenarios, test, verify, fix, report, and clean up

58

Quality

66%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./plugins/oh-my-codex/skills/ultraqa/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

70%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a clearly sequenced, validation-rich adversarial QA workflow with concrete commands and templates, but it is over-long for a single SKILL.md with notable redundancy and no progressive disclosure into reference files.

Suggestions

Move the detailed State Tracking command catalog and the full Structured Report template into reference files (e.g. references/state-tracking.md, references/report-template.md) and link to them from the body.

Collapse the 'Important Rules' section since it duplicates the Required Scenario Matrix and Safety Bounds content, or keep only the rules not already stated.

Consolidate the repeated omx state write examples into a single parameterized pattern to reduce token weight.

DimensionReasoningScore

Conciseness

Mostly dense and operational, but the 'Important Rules' section restates the scenario matrix classes and the State Tracking block repeats many near-identical omx commands, so it could be tightened.

3 / 5

Actionability

Provides copy-paste-ready omx state commands, a concrete report template, and harness guardrails with real code (pathToFileURL, env -u), though the core e2e generation remains procedural guidance.

4 / 5

Workflow Clarity

An explicit 8-step cycle with a CHECK RESULT validation gate, diagnose→fix→retest feedback loops, an exit-condition table, and a scenario-matrix checklist — validation is present so no destructive-skill cap applies.

5 / 5

Progressive Disclosure

Well-sectioned but monolithic at ~258 lines with no bundle references; detailed state-tracking commands, the report template, and repeated scenario definitions are inlined rather than offloaded to reference files.

3 / 5

Total

15

/

20

Passed

Description

63%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific and distinct, listing a comprehensive set of concrete workflow actions, but it omits any explicit 'when to use' trigger guidance and relies on somewhat technical jargon over natural user phrasing.

Suggestions

Add a 'Use when...' clause with natural trigger phrases such as 'when you need adversarial end-to-end testing, regression QA, or hostile-scenario verification'.

Soften jargon by including everyday synonyms users actually say, e.g. 'end-to-end testing', 'regression testing', and 'QA verification'.

State the when/explicit trigger alongside the what so completeness can move above 3.

DimensionReasoningScore

Specificity

Lists six concrete actions ('generate hostile scenarios, test, verify, fix, report, and clean up') covering the full workflow, matching the comprehensive-coverage anchor.

5 / 5

Completeness

Clearly states what the skill does but provides no 'Use when...' trigger guidance, capping completeness at 3 per the missing-trigger-clause guideline.

3 / 5

Trigger Term Quality

Has relevant keywords ('e2e QA', 'test', 'verify', 'hostile scenarios') but they lean technical and miss common natural synonyms like 'testing' or 'end-to-end'.

3 / 5

Distinctiveness Conflict Risk

The 'adversarial dynamic e2e QA' framing carves a distinct niche, with only minor overlap risk against general QA/test skills.

4 / 5

Total

15

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
Yeachan-Heo/oh-my-codex
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.