CtrlK
BlogDocsLog inGet started
Tessl Logo

prepare-providers-documentation

Replace the manual commit-by-commit classification step in `breeze release-management prepare-provider-documentation` with AI-driven classification. For each provider with pending changes, analyze every PR (batched into one sub-agent per provider, not one per PR), pay special attention to potentially breaking changes by inspecting the actual diff, scope multi-provider PRs to the current provider's slice, ask the release manager when uncertain, and apply version bumps + changelog entries. Use during the regular provider release cycle as an alternative to the interactive breeze prompts.

71

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an exceptionally actionable, well-sequenced operational playbook with genuine validation gates and feedback loops — everything a release manager needs to run the flow. Its weaknesses are structural: it is a monolithic 58KB single file that restates several cross-cutting rules three to four times across phases, where a leaner SKILL.md pointing at reference files for the sub-agent brief, changelog rules, and incremental flow would serve both conciseness and progressive disclosure better.

Suggestions

Split into bundle files: move the Phase 3 sub-agent briefing, the Phase 4b changelog-entry rulebook, and the Incremental Update flow into references/*.md, keeping SKILL.md as an overview with one-level-deep pointers (addresses progressive_disclosure).

State each cross-cutting rule once — the skip-vs-tooling rule, the "allow provider dependency bump" label requirement, and the "update-providers-next-version" reminder each appear 3-4 times across phases; have the Phase 5 checklist cross-reference the single canonical statement instead of restating it (addresses conciseness).

Compress the dated incident anecdotes (2026-08-01 wave PR enumerations, 2026-07-22 atlassian.jira story) to one-line cautionary examples; they are time-sensitive and add substantial tokens to every skill load (addresses conciseness).

DimensionReasoningScore

Conciseness

Almost everything is project-specific knowledge Claude cannot derive (breeze internals, tag gotchas, changelog conventions), but several multi-paragraph rules are restated three to four times — the skip-vs-tooling rule appears in the Phase 3 note, the Phase 3 warning, the sub-agent prompt, and the Phase 5 scan list; the "allow provider dependency bump" label rule and the "update-providers-next-version" reminder each appear in 3-4 places — and dated incident anecdotes ("2026-08-01 wave", "coherent gained #69649...") add token weight. Not 4: the cross-section repetition is more than minor over-explanation; not 2: there is no padding or explanation of concepts Claude already knows.

3 / 5

Actionability

Fully executable throughout: exact breeze commands with flags, copy-paste git pipelines (tag selection with sentinel/rc gotchas handled), a complete sub-agent briefing template with exact output format, the exact RST changelog skeleton, and decision tables mapping classification to version bump and section. Not 4: the common cases are covered end-to-end with commands and formats Claude can run verbatim.

5 / 5

Workflow Clarity

Five numbered phases plus a parallel incremental flow, each sequenced with inputs and outputs; Phase 5 is a mandatory validation gate with explicit checks (prek run, idempotent reapply, "python3 dev/check_changelog_entries.py --fix" with a MISSING/UNKNOWN/SECTION/ORDER defect table and a repair action per code), re-run-after-rebase feedback loops, and RM escalation checkpoints. Not 4: validation steps are explicit, mandatory, and paired with per-failure repair actions — the anchor-5 feedback-loop pattern.

5 / 5

Progressive Disclosure

A single ~58KB SKILL.md with no references/, scripts/, or assets/ bundle files at all. Internal sectioning is strong and the repo-file pointers (provider_documentation.py, CHANGELOG_TEMPLATE.rst.jinja2) are one level deep and clearly signaled, but large self-contained blocks — the ~90-line sub-agent briefing, the changelog-entry rulebook, and the entire Incremental Update flow — are inlined where a skill of this size should split them into separate reference files. Not 4: inlining at this scale is more than a minor organization gap; not 2: the document is thoroughly structured and existing references are clearly signaled, not buried.

3 / 5

Total

16

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is exemplary: it names the exact breeze command it replaces, enumerates the concrete actions the skill performs, defines the escalation behavior, and closes with an explicit "Use during..." trigger clause. Both the what and the when are fully explicit, and the vocabulary matches exactly what a release manager would type when they need it.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "analyze every PR (batched into one sub-agent per provider...)", "inspecting the actual diff", "scope multi-provider PRs to the current provider's slice", "apply version bumps + changelog entries" — with comprehensive coverage of the workflow. Not 4: the action list covers the full pipeline (classify, inspect, scope, escalate, apply) with no coverage gaps.

5 / 5

Completeness

Explicitly answers both: the "what" is the full AI-driven classification pipeline, and the "when" is stated as "Use during the regular provider release cycle as an alternative to the interactive breeze prompts". Not 4: the trigger clause is explicit and concrete with trigger phrases, matching the anchor-5 example's structure.

5 / 5

Trigger Term Quality

Includes the exact command name "prepare-provider-documentation" plus natural release-manager phrases: "provider release cycle", "version bumps", "changelog entries", "interactive breeze prompts". Not 4: no natural term for this domain is missing — the precise breeze subcommand and the release-cycle phrasing are exactly what the target user would say.

5 / 5

Distinctiveness Conflict Risk

Names one specific breeze subcommand, the release-manager role, and provider-release-specific vocabulary — a clear niche no other plausible skill would trigger on. Not 4: the triggers are uniquely tied to this single workflow, giving minimal conflict risk.

5 / 5

Total

20

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (1156 lines); consider splitting into references/ and linking

Warning

referenced_paths_exist

Referenced path issues: 1 missing, 1 deeper-than-1-level

Warning

Total

14

/

16

Passed

Repository
apache/airflow
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.