CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

phoenix-release-notes

Create Phoenix release documentation grounded in actual code changes. Use this skill whenever the user asks to write release notes, document a release, update release documentation, or mentions undocumented releases. Also trigger when the user wants to update GitHub release descriptions, add entries to the release notes page, or asks what changed in a recent Phoenix version.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A highly actionable, well-sequenced workflow skill with excellent validation and feedback loops. Its main cost is length and redundancy — several rules are enforced through repetition across sections, checklists, and scripts, which inflates token usage without adding new information.

Suggestions

State the frontmatter title rule ('MM.DD.YYYY: Descriptive Title', never 'Release Notes') once in Step 3 and reference it from the checklist and validation script instead of repeating the full rule with examples in three or four places.

Consolidate the reverse-chronological ordering guidance: keep the wrong/right diagrams and insertion procedure in Step 4, and reduce the checklist and Decision Quick Reference entries to one-line pointers.

Consider moving the Slack mrkdwn formatting rules and template, plus the validation grep/awk scripts, into reference files (e.g., references/slack-format.md, references/validation.sh) linked from Step 9 and Step 8 to shrink the always-loaded SKILL.md body.

DimensionReasoningScore

Conciseness

The body is mostly efficient project-specific guidance, but rules are restated multiple times: the frontmatter title format and the 'never use "Release Notes"' prohibition appear in 'Frontmatter title rules', again in 'Format B', again in the quick validation grep, and again in the Pre-Submit Checklist; the reverse-chronological ordering rule is explained in Step 4 with wrong/right diagrams, a 4-step procedure, and repeated in two checklist items. This repetition goes beyond 'minor instances of over-explanation' (score 4) and matches the 'mostly efficient but could be tightened' anchor.

3 / 5

Actionability

Guidance is fully executable throughout: concrete `gh` commands for listing, viewing, and editing releases; exact file paths and directory conventions; complete MDX/JSON/JSX templates; ready-to-run grep/awk validation scripts with expected outputs ('MISSING:', 'OK:', 'OUT OF ORDER'); and a fill-in Slack mrkdwn template. Score 5 anchor (copy-paste ready commands covering common cases) is met; it is not below 5 because no pseudocode or placeholder-only sections exist.

5 / 5

Workflow Clarity

Nine explicitly sequenced steps cover identification through publishing, with a dedicated verification step containing validation commands, expected outputs, and a feedback loop ('After inserting, re-run the grep and read the dates top-to-bottom... fix it before moving on'), plus decision rules and a pre-submit checklist. This matches the score 5 anchor (clear sequence, explicit validation, feedback loops, checklists); the batch-editing operations all have validation checkpoints, so no cap applies.

5 / 5

Progressive Disclosure

The file has no bundle files and keeps everything inline, but it is well-sectioned with numbered steps, tables, a Decision Quick Reference, and a checklist that make a ~590-line document navigable. It falls short of score 5 because substantial self-contained material (the Slack formatting guide, full MDX templates, validation scripts) could plausibly live in one-level-deep reference files, but it is above score 3 since the structure is good and no content is buried or poorly signaled.

4 / 5

Total

17

/

20

Passed

Description

90%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with explicit what/when structure and comprehensive, natural trigger phrasing scoped to a clear niche. Its only weakness is that the capability statement covers a single action rather than previewing the fuller workflow.

DimensionReasoningScore

Specificity

The description states one concrete action — 'Create Phoenix release documentation grounded in actual code changes' — which names the domain plus a single capability; it does not enumerate the multiple sub-actions (identify undocumented releases, analyze commits, update docs touchpoints) that the skill actually performs, matching the '1-2 concrete actions, but not comprehensive' anchor. It is above score 2 because the action stated is specific rather than generic, and below score 4 because no additional concrete actions are listed.

3 / 5

Completeness

It explicitly answers 'what' ('Create Phoenix release documentation grounded in actual code changes') and 'when' with two explicit trigger clauses ('Use this skill whenever the user asks to...', 'Also trigger when the user wants to...'). This matches the anchor for clearly and explicitly answering both what and when with concrete trigger phrases.

5 / 5

Trigger Term Quality

It covers natural user phrasings comprehensively with synonyms: 'write release notes', 'document a release', 'update release documentation', 'mentions undocumented releases', 'update GitHub release descriptions', 'add entries to the release notes page', and 'asks what changed in a recent Phoenix version'. These are exactly the phrases a user would naturally say, matching the comprehensive-synonyms anchor; nothing significant is missing for this domain.

5 / 5

Distinctiveness Conflict Risk

The scope is tightly narrowed to Phoenix release documentation with Phoenix-specific trigger terms (GitHub release descriptions, release notes page, Phoenix versions), giving it a clear niche with minimal overlap risk against generic documentation or changelog skills. It uses an appropriate imperative third-person voice throughout.

5 / 5

Total

18

/

20

Passed

Validation

75%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 12 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (599 lines); consider splitting into references/ and linking

Warning

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

relative_links

Relative link issues: 1 missing

Warning

Total

12

/

16

Passed

Repository

Arize-ai/phoenix

Path

.agents/skills/phoenix-release-notes/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.