CtrlK
BlogDocsLog inGet started
Tessl Logo

triage-orchestra-pipeline

Diagnose a failed Orchestra pipeline, open a fix PR, validate it on a branch run, then present a human-readable triage summary and STOP for user approval before merging. Use this when the user wants to review the fix before it goes to main — not for fully automated fixes. Trigger on phrases like "triage my pipeline", "show me what's broken", "investigate but don't fix yet", "prepare a fix for review", or when the user explicitly wants a review gate before applying changes. Also trigger when the user describes a symptom in a downstream system ("dashboard looks wrong", "chart is stale", "dbt model has bad data") even if no pipeline error exists — the skill will trace the symptom upstream.

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is orchestra-hq/orchestra-skills

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered operational skill: an unambiguous multi-path workflow with explicit validation and feedback loops, copy-paste commands, and concrete output templates. The weaker spots are trimmable repetition, the wholesale delegation of the fix step to a sibling skill, and reference paths that escape the bundle's root.

Suggestions

State the fix-application essentials inline in Step 2 (branch off the failing branch, push, gh pr create) instead of delegating entirely to 'fix-orchestra-pipeline Step 5', so the skill remains actionable when the sibling is not installed.

Trim repetition: the no-merge rule already in the Step 2 heading does not need 'Do NOT merge. Do NOT call gh pr merge' restated, and the optional knowledge-store fallback can be mentioned once in Important notes only.

Make the shared references resolvable from the skill folder — either vendor them under a local references/ directory or document the expected parent layout in the Shared references section — so the '../../references/orchestra/...' paths are verifiable.

DimensionReasoningScore

Conciseness

The body is dense and operational — it never explains what dbt, Lightdash, or a GitHub PR is — but there is trimmable repetition: 'Do NOT merge. Do NOT call gh pr merge' restates the header, the knowledge-store opt-in is stated three times (Steps 1, Approval handling, Important notes), and Step 1 includes the parenthetical 'in two calls instead of five or six'. This fits the 4 anchor (efficient, minor over-explanation) rather than 5 (every token earns its place).

4 / 5

Actionability

Mostly executable: exact commands ('gh api repos/<owner>/<repo>/commits?sha=<branch>&per_page=10', 'gh pr merge <N> --repo <owner/repo> --squash --delete-branch'), a parameterized 'start_pipeline(...)' call, a 60s poll interval, and two complete output templates. It stays below the 5 anchor because the core fix application in Step 2 is delegated wholesale to 'fix-orchestra-pipeline Step 5' rather than specified, leaving a gap if that sibling skill is unavailable.

4 / 5

Workflow Clarity

Clear sequence (Step 0 input classification → 0b upstream traversal → diagnose → PR without merge → branch validation → summary and stop) with explicit validation checkpoints (branch run polled to terminal state) and real feedback loops: 'FAILED (same error): Return to Step 2, update the PR, re-validate', 'FAILED (different error): Diagnose it, extend the PR', plus approval/reject/intentional/feedback recovery paths. The destructive operation (merging to main) is explicitly gated.

5 / 5

Progressive Disclosure

A 'Shared references' section indexes the orchestra docs with one-line purposes ('diagnosis-patterns.md — error classification', 'tools-quick-ref.md — tool arguments and behaviour') and keeps the operational workflow inline, which is good structure. It falls short of 5 because the referenced paths ('../../references/orchestra/...') point two levels outside the skill folder with an indirect '../../' indirection, and no reference files ship in this bundle, so the navigation cannot be verified from the skill itself.

4 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: concrete third-person action list, explicit use-when guidance with quoted trigger phrases in both request and symptom form, a negative boundary against the fully-automated sibling skill, and no filler. All four dimensions sit at the top anchor.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Diagnose a failed Orchestra pipeline, open a fix PR, validate it on a branch run, then present a human-readable triage summary and STOP for user approval before merging' and 'the skill will trace the symptom upstream' — in third-person voice with comprehensive coverage of the skill's behavior. It exceeds the 4 anchor because no meaningful capability is left unstated.

5 / 5

Completeness

Explicitly answers 'what' (diagnose, open PR, validate on a branch, present summary, stop for approval) and 'when' ('Use this when the user wants to review the fix before it goes to main — not for fully automated fixes', 'Trigger on phrases like...'), plus a negative boundary. This matches the anchor-5 example pattern exactly.

5 / 5

Trigger Term Quality

Quotes natural user phrasings across both request-style ('triage my pipeline', 'show me what's broken', 'investigate but don't fix yet', 'prepare a fix for review') and symptom-style triggers ('dashboard looks wrong', 'chart is stale', 'dbt model has bad data'), giving comprehensive coverage with synonym variation. The 4 anchor ('a few natural terms missing') fits worse since both trigger families are covered.

5 / 5

Distinctiveness Conflict Risk

Clear niche — Orchestra pipeline triage with a human review gate — with distinct trigger phrases and an explicit carve-out ('not for fully automated fixes') that separates it from a sibling auto-fix skill. The explicit boundary brings it above the 4 anchor's 'minor overlap risk'.

5 / 5

Total

20

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 missing

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository
orchestra-hq/orchestra-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.