CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

phoenix-skills-audit

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — `phoenix-tracing`, `phoenix-cli`, and `phoenix-evals` — so they stay in sync with what actually shipped. Use this skill whenever a user asks to update those skills, sync the skills with recent changes, audit skill drift, check what client/CLI/API changes need to land in the skills, or mentions "skill freshness", "skill drift", "stale skills", or "are the skills up to date". Also trigger when shipping a notable client/CLI/API change and the user asks "do the skills need updating?". Default window is the last 7 days on `origin/main`; user may override.

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

85%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, highly actionable body: the six-phase workflow with validation checkpoints, grounding rules, and checklists is exemplary for a destructive/batch editing task. The main weaknesses are mild cross-section repetition of the same rules (conciseness) and the absence of any progressive disclosure — everything, including the writing-style guide and run-summary template, is inlined in one long file.

Suggestions

Extract the Writing-style section and the Phase 6 run-summary template into references/ files (e.g. references/writing-style.md and references/run-summary-template.md), linking them from a short style note in SKILL.md — this shortens the always-loaded body while keeping detail one level deep.

De-duplicate rules stated three times: keep Quote signatures verbatim, the feature-flag exclusion, and the TS-mirror check in their primary sections, and have the Decision quick reference and pre-submit checklist point to them rather than restate them.

Trim the motivational framing (e.g. the paragraph on why skill drift is strictly worse than drift in human-facing docs, and the closing line about poisoning every future agent) to one sentence, since the operational rules already encode the priority.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence — no basic-concept explanations — with concrete git commands and a copy-paste run-summary template. However, several rules are stated three times across sections: Quote signatures verbatim appears in Phase 5, Grounding rules (with the def foo(trace_id...) example), and the pre-submit checklist; the feature-flag exclusion and the check-the-TS-mirror rule are each repeated in Phase 2/3 and the Decision quick reference. That repetition could be trimmed. Not 5 because of this duplicated guidance; not 3 because nearly every token is actionable rather than explanatory padding.

4 / 5

Actionability

Fully executable guidance throughout: concrete git commands (git fetch origin main --quiet; git log --since 7 days ago origin/main --no-merges with pretty format and name-status), exact file paths (.agents/skills/phoenix-tracing/references/*.md), a verbatim run-summary markdown template, and a decision table with specific answers. Not 4 because there are no pseudocode gaps — every instruction is copy-paste ready or names exact files and commands.

5 / 5

Workflow Clarity

Six clearly sequenced phases with explicit validation and feedback loops: a sanity check (git rev-list --count main..origin/main), post-edit verification in Phase 5 (Verify the example runs against the current code; Verify cross-links resolve), a reconciliation rule for dropped candidates (a tagged candidate that just disappears is a triage bug — go back and reconcile), and a pre-submit checklist. This matches the top anchor including the checklist pattern for a batch/destructive editing operation. Not 4 because validation checkpoints are explicit at every phase, not merely present.

5 / 5

Progressive Disclosure

Sections are well-organized with clear headers (Targets, Source mapping, Workflow, Grounding rules, Writing style, Decision quick reference, Pre-submit checklist, Operating modes), but the skill is a single ~350-line monolith with no bundle files at all — no references/ directory exists. Content that would naturally live one level deeper, such as the Writing-style rules (~35 lines) and the run-summary template (~35 lines), is fully inlined. This matches the anchor: some structure, content that should be separate is inline. Not 4 because the inlined style guide and template are exactly the kind of detailed material the rubric expects split into a referenced file; not 2 because the section structure is genuinely good and nothing is buried or hard to navigate.

3 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: it states the exact action (audit + patch), the exact targets (three named skills), the surfaces in scope, multiple natural trigger phrases including quoted user questions, and a concrete default window with an override note. All four dimensions hit the top anchor without any fluff or over-claiming.

DimensionReasoningScore

Specificity

Names multiple concrete actions — 'Audit recent changes to Phoenix user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli, and phoenix-evals' — and even specifies the default window (last 7 days on origin/main). Coverage is comprehensive with no vague filler. Not 4 because there are no minor gaps: domain, actions, targets, and scope boundaries are all explicit.

5 / 5

Completeness

Explicitly answers both questions: what (audit recent changes and patch the three external-facing agent skills so they stay in sync with what actually shipped) and when (Use this skill whenever a user asks to update those skills, sync the skills, audit skill drift, or mentions skill freshness / skill drift / stale skills / are the skills up to date). Concrete trigger phrases accompany both. Not 4 because the when-clause is already fully explicit, not merely improvable.

5 / 5

Trigger Term Quality

Comprehensive natural-language triggers with synonyms: 'update those skills', 'sync the skills with recent changes', 'audit skill drift', 'skill freshness', 'skill drift', 'stale skills', 'are the skills up to date', and 'do the skills need updating?'. These are exactly the phrases a user would naturally say. Not 4 because no common variation is missing — the list even covers the shipping-side question.

5 / 5

Distinctiveness Conflict Risk

Clear niche — keeping the three named Phoenix skills in sync with shipped code — with distinct, unambiguous triggers (skill drift, stale skills, are the skills up to date). It is unlikely to fire for unrelated skills. Not 4 because the triggers are specific enough that even a sibling audit skill such as a docs-gap audit would not overlap on these phrases.

5 / 5

Total

20

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

referenced_paths_exist

Referenced path issues: 4 missing

Warning

Total

13

/

16

Passed

Repository

Arize-ai/phoenix

Path

.agents/skills/phoenix-skills-audit/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.