CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

phoenix-skills-audit

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — `phoenix-tracing`, `phoenix-cli`, and `phoenix-evals` — so they stay in sync with what actually shipped. Use this skill whenever a user asks to update those skills, sync the skills with recent changes, audit skill drift, check what client/CLI/API changes need to land in the skills, or mentions "skill freshness", "skill drift", "stale skills", or "are the skills up to date". Also trigger when shipping a notable client/CLI/API change and the user asks "do the skills need updating?". Default window is the last 7 days on `origin/main`; user may override.

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a strongly engineered procedural skill: a six-phase workflow with real validation checkpoints and reconciliation feedback loops, copy-paste-ready commands, concrete mapping and naming rules, and an explicit output contract for the run summary. Its one real weakness is token efficiency — the same grounding rules are stated two or three times across the phases, the decision quick reference, and the pre-submit checklist, which inflates context cost without adding information. Structure and navigation are good for a single-file skill, though the style guide and summary template are natural candidates for reference files.

Suggestions

State each grounding rule once in an authoritative section and have the pre-submit checklist reference them by name — "Quote signatures verbatim" currently appears verbatim in both Phase 5 and Grounding rules, and the feature-flag skip rule (with its identical *_DANGEROUSLY_* / *_EXPERIMENTAL_* parenthetical) appears three times (Phase 2, decision quick reference, checklist).

Prune decision-quick-reference rows that restate Phase 2/3 policy (refactor diffs, TS mirrors, feature flags, file-path-vs-concept mapping) and keep the table only for decisions not already covered in the phases, cutting duplication while preserving the Q&A access pattern for genuinely new questions.

Trim the motivational rationale that repeats across sections — the 'agents cannot sanity-check, so stale skills poison downstream tasks' framing appears in both the intro and the Grounding rules — and merge the Phase 2 and Phase 3 cautions about commit messages lying/under-reporting into one statement.

DimensionReasoningScore

Conciseness

The body teaches nothing Claude already knows and every section carries repo-specific policy, but the same rules are restated across sections: "Quote signatures verbatim" appears in both Phase 5 and Grounding rules, the feature-flag skip rule appears in Phase 2, the decision quick reference, and the pre-submit checklist, and the commit-messages-lie caution is repeated in Phases 2 and 3. Mostly efficient, but consolidating the recaps would trim roughly a fifth of the file. Not 4 because the duplication exceeds 'minor instances'; not 2 because nothing is padded filler or explanation of known concepts.

3 / 5

Actionability

Fully executable guidance throughout: copy-paste-ready git commands (git fetch origin main --quiet; git log --since="7 days ago" origin/main --no-merges --pretty=format:"%h %s" --name-status), a concrete source-to-skill mapping table, exact reference-file naming conventions, a complete run-summary markdown template, and a decision Q&A covering the common cases. The only placeholders (git log <prev-tag>..<current-tag>) are explicitly justified as user-specified ranges.

5 / 5

Workflow Clarity

Six clearly sequenced phases with explicit validation checkpoints ("Verify the example runs against the current code", "Verify cross-links resolve", the git rev-list sanity check), a genuine feedback loop ("A tagged candidate that just disappears is a triage bug — go back and reconcile"), destructive-edit pairing rules, and a pre-submit checklist. This matches the anchor-5 pattern of sequence + validation + error-recovery loops; the destructive/batch cap does not apply because verification is pervasive.

5 / 5

Progressive Disclosure

A single-file process skill with no bundle files, where all content (triage rules, mapping table, style rules, summary template) is needed on every run, so inlining is defensible and the section structure with headers and tables is easy to navigate. Not 5 because at ~350 lines the writing-style guide and run-summary template are long enough that they could plausibly live in one-level-deep reference files, leaving SKILL.md as a leaner overview — a minor organization gap rather than the 'content that should be separate is inline' problem of anchor 3.

4 / 5

Total

17

/

20

Passed

Description

95%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is exemplary: it states a precise what (audit + patch three named skills against enumerated user-facing surfaces) and an explicit when with a rich set of natural trigger phrases and synonyms, plus the operating default (7-day window on origin/main). Third-person voice is maintained and nothing is padded or overclaimed. The only minor gap is that it does not mention the run-summary output artifact that the workflow produces.

DimensionReasoningScore

Specificity

Two explicit, highly concrete actions — "Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs)" and "patch the three external-facing agent skills" — with every object enumerated (four surface types, three named skills). It falls short of anchor 5's comprehensive action list only because downstream outputs (e.g., the run summary) are not stated, but sits well above anchor 3's bare 1-2 unspecified actions.

4 / 5

Completeness

Explicitly answers both questions: what ("Audit recent changes... and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli, and phoenix-evals — so they stay in sync with what actually shipped") and when ("Use this skill whenever a user asks to update those skills... or mentions 'skill freshness', 'skill drift', 'stale skills', or 'are the skills up to date'") with concrete trigger phrases. Not score 4 because the 'when' clause is fully explicit with multiple specific triggers, not merely present.

5 / 5

Trigger Term Quality

Comprehensive natural-term coverage with synonyms and quoted phrasings users would actually say: "skill freshness", "skill drift", "stale skills", "are the skills up to date", "do the skills need updating?", plus "sync the skills with recent changes" and "audit skill drift". Matches the anchor-5 pattern of including common variations.

5 / 5

Distinctiveness Conflict Risk

Clear niche — keeping Phoenix's three named agent skills truthful about shipped client/CLI/API changes — with triggers consistently scoped to "skills" rather than docs or general auditing, so even the closely related docs-gap audit is unlikely to collide. Distinctive named artifacts (phoenix-tracing, phoenix-cli, phoenix-evals) minimize wrong-skill triggering.

5 / 5

Total

19

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

referenced_paths_exist

Referenced path issues: 4 missing

Warning

Total

13

/

16

Passed

Repository

Arize-ai/phoenix

Path

.agents/skills/phoenix-skills-audit/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.