CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

changelog-scan

Scan recent merges to main (and noteworthy direct commits) since a given window (last tag or date in state). Extract titles, labels, types, linked issues, and signals for breaking changes or security. Produces structured input for a release notes drafter. Use in changelog-drafter loops.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A lean, well-structured instruction-only skill: exact output templates, explicit inclusion rules and signal keywords, source-citation requirements, and a sensible prompt-injection guard for untrusted repo text. The only real weaknesses are operational — the retrieval mechanism (gh/git commands) is left implicit, and the precedence for resolving the scan window is unspecified.

Suggestions

Add the concrete retrieval commands for the scan (e.g., `gh pr list --base main --state merged --search "merged:>=$SINCE"` and/or `git log --since=... --first-parent main`) so the core operation is copy-paste executable.

State the precedence for resolving the scan window when multiple inputs are present (explicit 'since' override > last release tag > previous run timestamp), and what to do if none is available.

DimensionReasoningScore

Conciseness

The body explains nothing Claude already knows and contains no padding: every section is directive — an exact output template, inclusion/exclusion rules, keyword lists, a summary format, and a cite-your-sources rule. The untrusted-input block is generated safety guidance with clear rules, not concept explanation, so this matches 'lean and efficient; every token earns its place' rather than the minor-trimming anchor at 4.

5 / 5

Actionability

The guidance is highly concrete: a copy-paste-ready per-item output block, explicit rules ("All merged PRs to main in the window", "Ignore pure dependency bumps, internal chores, and bot PRs unless security-related"), exact signal keywords, and a fixed summary format with enumerated next actions. The one notable gap is that no retrieval command is given (e.g., `gh pr list --state merged --base main` or `git log`), so the core scan operation is directed but not executable as written — 'mostly executable with minor gaps' rather than fully copy-paste-ready at 5.

4 / 5

Workflow Clarity

The flow is clear and ordered in practice — resolve the window from provided inputs, scan merges, apply inclusion rules, surface signals, emit per-item blocks, then append the Scan Summary with a recommended next action. Checkpoints are mostly present: "Be precise and cite sources (PR numbers / shas). Do not invent details" acts as per-item validation, and the summary's "Recommended next action" is an output gate. Minor gaps remain (no explicit precedence for tag vs. timestamp vs. override when resolving the window), fitting 'clear sequence with most checkpoints present; minor validation gaps' — below the explicit validate/fix/retry loop at 5, above the implicit-checkpoint anchor at 3.

4 / 5

Progressive Disclosure

This is a compact, self-contained skill with no bundle files (no references/, scripts/, or assets/ exist) and nothing that needs splitting out. Sections are clearly labeled and well-ordered (Inputs, Output Format, rules, Additional Signals, Scan Summary, Untrusted input), so under the simple-skill guideline it earns the top score for well-organized single-file structure.

5 / 5

Total

18

/

20

Passed

Description

80%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete, unpadded actions with a clear input-to-output story and an explicit trigger clause. The main gaps are missing natural synonyms (changelog, pull requests/PRs) and a 'when' clause aimed at loop machinery rather than at the situations where a user would need this skill.

Suggestions

Add natural trigger terms and synonyms — e.g., "changelog", "release notes", "pull requests (PRs)" — so the description matches the phrases users actually say.

Broaden the 'when' clause from "Use in changelog-drafter loops" to also name user-facing scenarios, e.g., "Use when preparing a changelog or release notes for recent merged work".

DimensionReasoningScore

Specificity

The description lists multiple concrete actions with comprehensive coverage for its domain: "Scan recent merges to main (and noteworthy direct commits)", "Extract titles, labels, types, linked issues, and signals for breaking changes or security", and "Produces structured input for a release notes drafter". No vague or padded language appears, matching the top anchor rather than the 'several specific actions with minor gaps' anchor below it.

5 / 5

Completeness

Both 'what' (scan merges, extract metadata, produce structured input) and 'when' ("Use in changelog-drafter loops") are present. The 'when' clause is explicit but narrow and system-oriented rather than a concrete user-facing trigger (e.g., 'Use when drafting a changelog or release notes'), matching 'both what and when; when could be more explicit or specific' — below the concrete-trigger-phrases anchor at 5, above the missing/weak-when anchor at 3.

4 / 5

Trigger Term Quality

Good keyword coverage exists ("merges", "main", "breaking changes", "security", "release notes", "labels"), but common natural terms users would say are missing — notably "changelog", "pull requests"/"PRs", and "since tag/date" phrasing. This fits 'good coverage; a few natural terms missing' rather than the comprehensive-synonyms anchor at 5.

4 / 5

Distinctiveness Conflict Risk

The niche (an upstream scanner feeding a release-notes drafter loop) is fairly distinct with specific triggers, but a closely related release-notes-drafter or PR-summary skill would overlap on terms like "merges", "titles", and "release notes". This matches 'mostly distinct; minor overlap risk with closely related skills' rather than the minimal-conflict anchor at 5.

4 / 5

Total

17

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

cobusgreyling/loop-engineering

Path

starters/changelog-drafter/.grok/skills/changelog-scan/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.