CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

varnish-test-vtc-syntax

Use when a Varnish caching layer or VCL change needs tests: varnishtest VTC files with server, client and varnish blocks, grace and saint modes, PURGE handlers with ACLs, and surrogate-key invalidation with the xkey vmod.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/varnish-test-vtc-syntax

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, example-heavy reference that is largely actionable and efficient, with a clear author-to-CI progression and useful anti-patterns. Its main weaknesses are two non-self-contained examples (grace and PURGE VTCs), a saint-mode gap versus the description's promise, and some duplicated x-cache logic and filler statements.

Suggestions

Make the grace-mode VTC self-contained: its VCL block only sets "beresp.grace = 60s" but the client asserts "resp.http.x-cache == \"GRACE\"", so include the vcl_deliver snippet that sets the header (or drop the header assertion) so the example runs as written.

Complete the PURGE test as a full VTC (server + varnish block containing the ACL/purge VCL + client) so it is copy-paste runnable, and add the saint-mode pattern the description promises.

Trim redundancy: the x-cache header logic and "Per Varnish docs" framing appear multiple times, obvious statements like "Exit code 0 = pass; non-zero = fail" can go, and the References section lists redis-cache-tests twice.

DimensionReasoningScore

Conciseness

Mostly efficient and code-forward, but contains trimmable redundancy: the x-cache header logic appears in both the grace VCL snippet and the grace VTC's expectations, "Per Varnish docs" repeats three times, and obvious statements ("Exit code 0 = pass; non-zero = fail", explaining that VCL is Varnish's configuration language) assume too little of Claude. Not anchor 5 because these extras don't all earn their place; not anchor 3 because there are no concept-teaching paragraphs.

4 / 5

Actionability

Abundant concrete, mostly executable guidance (install commands, full VTC anatomy, VCL patterns, run commands, CI yaml), but two examples are not runnable as written: the grace-mode VTC's VCL only sets "beresp.grace = 60s" while the client expects "resp.http.x-cache == \"GRACE\"" with no vcl_deliver setting it, and the PURGE VTC is a client fragment with no varnish block wiring in the ACL VCL. Saint mode is promised by the description but never shown. This is more than pseudocode-level incompleteness, so above anchor 3, but short of fully copy-paste-ready anchor 5.

4 / 5

Workflow Clarity

The section order (Authoring → Running → Parsing results → CI integration) forms a clear sequence with most checkpoints present: "varnish v1 -expect cache_hit == 1" counter assertions, pass/FAILED output parsing, the 403-from-external-IP ACL check, and "-vvv" for failure logs. It stops short of anchor 5 because the failure-recovery loop (run → fail → inspect with -vvv → fix) is only implicit in the anti-patterns table rather than an explicit step.

4 / 5

Progressive Disclosure

The single SKILL.md is well-sectioned and content is reasonably inlined at ~270 lines, with no bundle files to organize. Minor gaps keep it below anchor 5: the per-feature patterns (PURGE, grace, xkey) could be split into references/, and the body cites "redis-cache-tests references/stale-while-revalidate.md" — a path inside a different skill's bundle, which is mildly confusing. Structure is clearly above anchor 3's 'could be better organized'.

4 / 5

Total

16

/

20

Passed

Description

95%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, trigger-rich description that clearly names its niche and both what it covers and when to use it. The only weakness is that capabilities are listed as topic noun-phrases without explicit verbs, and the running/CI side of the skill is not represented.

DimensionReasoningScore

Specificity

Lists several concrete capabilities ("server, client and varnish blocks", "PURGE handlers with ACLs", "surrogate-key invalidation with the xkey vmod") but frames them as noun phrases rather than explicit actions and omits the running/CI/debugging scope the skill body covers. It exceeds anchor 3 (only 1-2 actions) but falls short of anchor 5's comprehensive action coverage.

4 / 5

Completeness

Explicitly answers both parts: "Use when a Varnish caching layer or VCL change needs tests" gives concrete when-triggers, and the colon-scoped list gives a concrete what. This matches the anchor-5 pattern of both what and when with concrete trigger phrases, above anchor 4's generic 'when'.

5 / 5

Trigger Term Quality

Covers the natural domain vocabulary a user would say: "Varnish caching layer", "VCL", "varnishtest VTC files", "PURGE", "grace and saint modes", "surrogate-key", "xkey vmod". Within this niche the tool name, file type, config language, and feature synonyms are all present, matching comprehensive coverage.

5 / 5

Distinctiveness Conflict Risk

Firmly pinned to the Varnish/VCL/varnishtest niche with distinct domain-specific triggers ("PURGE handlers", "xkey vmod", "grace and saint modes"), so it is unlikely to fire for nginx/CDN or generic testing skills. Clear niche with minimal conflict risk.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 3 missing

Warning

Total

15

/

16

Passed

Repository

testland/qa

Path

plugins/qa-cache-testing/skills/varnish-test-vtc-syntax/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.