CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

changelog-scan

Scan recent merges/PRs/commits for release note content. Structured output for drafter.

Quality

59%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./starters/changelog-drafter/.claude/skills/changelog-scan/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

47%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is admirably lean and the prompt-injection safety block is relevant given the skill ingests untrusted PR/commit text, but the skill is not self-contained: its contract lives in an unshipped "Grok version", and the output format (per-item blocks, Scan Summary, structured output) is never defined. Inlining the contract or a block template would fix the biggest gaps.

Suggestions

Inline the contract instead of referencing "the Grok version" — define or template the per-item block and Scan Summary formats (or point to a real reference file in the bundle).

Add a short step sequence (gather merges/PRs/commits → classify per key rules → emit blocks → assemble summary) with a validation checkpoint that every cited PR number was actually seen in the scanned range.

State what range "recent" means (e.g., since last release tag) so the scan scope is unambiguous.

DimensionReasoningScore

Conciseness

The core guidance ("Key rules: cite PR numbers, surface breaking/security explicitly, ignore pure dep and bot noise unless security") is lean and assumes Claude's competence, but the generated untrusted-input block has some redundancy across bullets that could be trimmed — anchor 4 (efficient, minor over-explanation) rather than 5, whose requirement that every token earn its place is slightly violated by the boilerplate's repetition.

4 / 5

Actionability

"Same contract as the Grok version" points to a contract that is not included in this skill, and the deliverables ("per-item blocks + Scan Summary", "structured output") are undefined — no template, example, or format spec appears anywhere — matching anchor 2 (minimal concrete guidance, high-level hints missing specific steps); it is not 3 because there is no partially-complete concrete specification to build on.

2 / 5

Workflow Clarity

No steps or sequence are given — only output rules — leaving the scan-then-draft process entirely implicit with no validation checkpoints (e.g., how to verify all relevant PRs were covered or that blocks parse correctly); this matches anchor 2 (rough implied sequence with many gaps, validation absent) rather than 1 because the deliverables and rules at least imply the scan → produce-blocks → summary shape.

2 / 5

Progressive Disclosure

The body is short and sectioned, appropriate for a single-purpose skill, with the bulk of policy detail delegated to a generated block; however, the dangling "Grok version" reference and the unresolvable scripts/sync-untrusted-input.mjs mention keep it below anchor 5, fitting anchor 4 (good structure, minor organization gaps).

4 / 5

Total

12

/

20

Passed

Description

53%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise, in third person, and clearly states what the skill does, but it omits any "when to use" trigger guidance and uses an abstract phrase ("Structured output for drafter") that weakens both specificity and trigger-term coverage. Adding an explicit "Use when..." clause with natural synonyms (changelog, release notes) would raise completeness, trigger quality, and distinctiveness.

Suggestions

Add a "Use when..." clause, e.g. "Use when drafting release notes or a changelog from recent merges, PRs, or commits."

Replace "Structured output for drafter" with a more concrete statement of the output, e.g. "Produces per-item release-note blocks with PR numbers cited."

Include natural trigger synonyms such as "changelog", "release notes", and "draft" so users' phrasing matches the description.

DimensionReasoningScore

Specificity

The description names the domain ("merges/PRs/commits") and 1-2 actions ("Scan recent merges/PRs/commits for release note content", "Structured output for drafter"), but "structured output" is abstract with no detail on the output form — matching anchor 3 (names domain and 1-2 concrete actions, not comprehensive) rather than 4, which requires several specific actions.

3 / 5

Completeness

The "what" is clearly stated (scan merges/PRs/commits for release note content, structured output for a drafter) but there is no "Use when..." clause or equivalent trigger guidance; the judging guidelines explicitly cap completeness at 3 for a missing when-clause.

3 / 5

Trigger Term Quality

Relevant keywords are present ("merges", "PRs", "commits", "release note") but common variations users would naturally say — "changelog", "draft release notes", "release notes" — are missing, matching anchor 3 (some relevant keywords, missing common variations) rather than 4.

3 / 5

Distinctiveness Conflict Risk

Extracting release-note content from merges/PRs/commits is a fairly distinct niche with minor overlap risk against code-review or changelog-formatting skills — mostly distinct (anchor 4), not 5 (triggers are terse and lack the natural phrases that would fully separate it), and clearly more specific than anchor 3's generic "works with document files" profile.

4 / 5

Total

13

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

cobusgreyling/loop-engineering

Path

starters/changelog-drafter/.claude/skills/changelog-scan/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.