CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

triage-orchestra-pipeline

Diagnose a failed Orchestra pipeline, open a fix PR, validate it on a branch run, then present a human-readable triage summary and STOP for user approval before merging. Use this when the user wants to review the fix before it goes to main — not for fully automated fixes. Trigger on phrases like "triage my pipeline", "show me what's broken", "investigate but don't fix yet", "prepare a fix for review", or when the user explicitly wants a review gate before applying changes. Also trigger when the user describes a symptom in a downstream system ("dashboard looks wrong", "chart is stale", "dbt model has bad data") even if no pipeline error exists — the skill will trace the symptom upstream.

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

The canonical home for this skill is orchestra-hq/orchestra-skills

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, highly actionable workflow with concrete MCP and GitHub commands, explicit validation loops, and complete output templates for both the error-first and symptom-first paths. Minor deductions: duplicated template structure and repeated merge warnings cost some conciseness, and every reference plus the fix procedure lives outside the skill folder, unverified in this bundle.

Suggestions

Consolidate the shared sections of the error-first and symptom-first output templates (PR table, branch validation, "Why this fixes it") into one common block with path-specific fields to remove duplication.

Inline or summarize the fix procedure from `fix-orchestra-pipeline` Step 5 so Step 2 is self-contained rather than depending on another skill's step numbering.

Ship the `references/orchestra/` files inside the skill's own bundle (with matching relative paths) so the referenced paths are verifiable at review time.

DimensionReasoningScore

Conciseness

Efficient and assumes Claude's competence (no explanation of git, dbt, or pipeline concepts), but the error-first and symptom-first output templates duplicate substantial shared structure (PR table, branch validation, "Why this fixes it") and the no-merge warning repeats across Step 2, Step 4, and Important notes. Not 5 because of these trimmable duplications; not 3 because there is no concept teaching or real padding.

4 / 5

Actionability

Copy-paste-ready guidance throughout: `gh api repos/<owner>/<repo>/commits?sha=<branch>&per_page=10`, a concrete `start_pipeline(alias_or_pipeline_id=..., branch=..., environment=...)` call, poll `get_pipeline_run_status` every 60 s, `gh pr merge <N> --repo <owner/repo> --squash --delete-branch`, and complete output templates for both paths. Not 4 because every mechanical step is executable as written.

5 / 5

Workflow Clarity

Explicit sequence (Step 0 classification → 0b upstream traversal with stop conditions → diagnosis → PR → branch validation → stop) with validation checkpoints and error-recovery loops ("FAILED (same error): … Return to Step 2, update the PR, re-validate"), a data-write safety warning before branch runs, and a four-way approval matrix (merge/reject/intentional/feedback). Not 4 because validation and feedback loops are explicit at every stage.

5 / 5

Progressive Disclosure

References are one level deep, listed up front with one-line descriptions, and pointed to at point of use (e.g. "see tools-quick-ref.md → Reach for these first"). Not 5 because all references live under `../../references/orchestra/` outside the skill folder — none present in this bundle to verify — and Step 2 depends on another skill's step ("Apply the fix exactly as in `fix-orchestra-pipeline` Step 5"); not 3 because the split of detail into reference files is appropriate and clearly signaled.

4 / 5

Total

18

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An excellent description: it states the full what, an explicit when with natural trigger phrases, and a negative boundary excluding fully automated fixes, all in third-person voice. Its only weakness is that the intentionally broad symptom triggers create some overlap risk with system-specific skills.

DimensionReasoningScore

Specificity

"Diagnose a failed Orchestra pipeline, open a fix PR, validate it on a branch run, then present a human-readable triage summary and STOP for user approval before merging" lists five concrete actions covering the workflow end-to-end, matching the comprehensive-coverage anchor. Not 4 because there are no coverage gaps in the action sequence.

5 / 5

Completeness

Explicitly answers what (diagnose → fix PR → branch validation → triage summary → stop for approval) and when ("Use this when the user wants to review the fix before it goes to main") with concrete trigger phrases and a negative boundary ("not for fully automated fixes"). Not 4 because the when-clause is fully explicit rather than merely present.

5 / 5

Trigger Term Quality

Natural trigger phrases a user would actually say — "triage my pipeline", "show me what's broken", "investigate but don't fix yet", "prepare a fix for review" — plus symptom phrasings "dashboard looks wrong", "chart is stale", "dbt model has bad data". Not 4 because coverage spans both intent-based and symptom-based variants comprehensively.

5 / 5

Distinctiveness Conflict Risk

Clear niche — Orchestra pipeline triage with a human review gate, explicitly "not for fully automated fixes" — but the generic symptom triggers ("chart is stale", "dbt model has bad data") create overlap risk with dbt/BI-specific skills. Not 5 because of that overlap; not 3 because the core triggers are strongly differentiated.

4 / 5

Total

19

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 2 missing

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

orchestra-hq/orchestra-skills

Path

skills/orchestra/skills/triage-orchestra-pipeline/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.