CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/ai-test-generator

Use when tests should be generated from acceptance criteria, user stories or requirements with an LLM. Scores confidence per test case (self-assessment plus assertion, naming and completeness checks), batches uncertain cases for human review and emits tests in the team's existing framework.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable skill: clear step sequence with real validation checkpoints and feedback loops, and exemplary progressive disclosure that pushes full scripts into a verified one-level-deep reference. The remaining gaps are minor — the generator snippet isn't runnable as-is, and there is light redundancy plus a dated model reference.

Suggestions

Make the Step 2 generator snippet self-contained: load input_yaml (e.g., yaml.safe_load(open('input/cart-promo.yaml'))) and parameterize framework/test_runner instead of hardcoding 'jest'.

Remove the hardcoded model='gpt-4' (or move it to a config variable) so the skill does not age with model version changes.

Merge the overlapping hallucinated-API guidance between Anti-patterns and Limitations, and drop or shrink the Step 6 ASCII diagram since the surrounding text already states the loop.

DimensionReasoningScore

Conciseness

The body is dense and code-forward with no explanations of concepts Claude already knows, but there are minor trim opportunities: the ASCII iteration diagram in Step 6 restates the preceding text, the Anti-patterns and Limitations sections overlap on hallucinated APIs, and the hardcoded 'gpt-4' model reference is time-sensitive. This matches anchor 4 ('efficient; minor instances that could be trimmed') rather than 5, where every token would earn its place.

4 / 5

Actionability

Concrete, mostly executable guidance throughout: a complete input YAML schema, copy-paste compile checks (npx tsc --noEmit, python -m py_compile, node --check), a fully specified score() function, and an output template. It sits at 4 rather than 5 because the Step 2 generator snippet is not self-contained — input_yaml is never loaded, there is no yaml import, and framework is hardcoded to 'jest' — so it needs assembly before running.

4 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced with an explicit validation checkpoint before scoring ("verify that generated test files parse and compile", with per-language commands and an automatic -50 downgrade), a review gate with a hand-off checklist, and a feedback loop ("Lessons fed back into prompt") for error recovery. This matches the 5 anchor: explicit validation steps, feedback loops, and a checklist for a batch operation.

5 / 5

Progressive Disclosure

The SKILL.md spine keeps a minimal runnable core and defers full scripts to references/generation-and-scoring.md, which exists, is one level deep, and is clearly signaled twice ("full script with helpers and the project-conventions injection is in [references/generation-and-scoring.md]"). The split is appropriate — the scoring rubric stays inline while parsing helpers live in the reference — matching the 5 anchor's well-signaled one-level-deep structure.

5 / 5

Total

18

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description in third-person voice that states concrete capabilities (confidence scoring with named checks, batching for review, framework-aware emission) and an explicit 'Use when' clause naming the triggering artifacts. Its only weakness is modest keyword breadth — a few natural synonyms for the AC-to-test domain are missing.

DimensionReasoningScore

Specificity

Quotes multiple concrete actions with sub-detail: "Scores confidence per test case (self-assessment plus assertion, naming and completeness checks)", "batches uncertain cases for human review", "emits tests in the team's existing framework" — covering the generate→score→curate pipeline comprehensively. It exceeds the score-4 anchor ('several specific actions; minor gaps') because the action list spans the whole workflow, not just part of it.

5 / 5

Completeness

Explicitly answers 'when' ("Use when tests should be generated from acceptance criteria, user stories or requirements with an LLM") and 'what' (confidence scoring, batching for human review, emitting in the existing framework) with concrete trigger phrases. Not a 4 because neither half is vague or implicit; the 'when' clause names specific input artifacts rather than a generic activity.

5 / 5

Trigger Term Quality

Natural trigger phrases are present — "tests should be generated", "acceptance criteria", "user stories", "requirements" — which users in this domain would plausibly say. It falls short of the 5 anchor because common synonyms like "test cases", "spec-to-test", "BDD/Gherkin", or "test suite" are absent.

4 / 5

Distinctiveness Conflict Risk

Clear niche — LLM-driven AC-to-test conversion with confidence-gated human review — that is distinct from generic test-writing or BDD skills. The 'acceptance criteria / user stories' framing gives it minimal overlap risk; a 4 would require some noticeable conflict with a closely related skill, which is not the case.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

15

/

16

Passed

Reviewed

On this page