CtrlK
BlogDocsLog inGet started
Tessl Logo

create-orchestra-pipeline

Create, validate, and remediate Orchestra pipeline definitions, as YAML or OML. Use when asked to build a new pipeline, add tasks to an existing pipeline, fix pipeline validation errors, or author Orchestra workflow definitions from a description. Trigger on phrases like "create a pipeline", "add a dbt task", "write orchestra yaml", "write orchestra oml", "fix validate errors", or when editing `.yml`, `.yaml` or `.oml` files under orchestra/ or similar pipeline directories.

72

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is orchestra-hq/orchestra-skills

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, well-structured workflow skill: clear sequencing with genuine validation and remediation feedback loops, concrete tooling commands, and sensible opinionated defaults. The main improvement opportunities are tightening minor redundancy, adding a minimal inline example skeleton, and moving references into the skill bundle with conventional relative paths.

Suggestions

Add a minimal inline pipeline skeleton (or point explicitly at a specific example in examples.md) so the common create-from-scratch case has a copy-adaptable starting structure without opening the reference.

Trim small redundancies — e.g. drop "Keep the summary concise" (already stated as "Summarise in a short paragraph or bullet list") and consolidate the three separate citations of yaml-authoring.md.

Bundle the reference files under references/ within the skill directory (e.g. references/yaml-authoring.md) instead of ../../references/orchestra/... so the paths resolve relative to the skill and the bundle is self-contained.

DimensionReasoningScore

Conciseness

Dense, opinionated guidance with no explanations of concepts Claude already knows; every step carries non-obvious, decision-relevant detail (Git-backed vs Orchestra-backed handling, OML validation caveats, editorial defaults). Minor trimmable redundancy — "Keep the summary concise" repeats the earlier "Summarise in a short paragraph", and yaml-authoring.md is cited in three places — so anchor 4 fits better than 5's "every token earns its place".

4 / 5

Actionability

Concrete, executable guidance throughout: "orchestra-cli validate <path/to/pipeline.yml>", "pip install orchestra-lang" with "oml_lang.analyze(source).errors()", MCP tool names, "${{ MATRIX.key }}" syntax, and a hard 5-attempt remediation cap. Minor gaps keep it below anchor 5 — no inline minimal pipeline skeleton (everything structural is deferred to references) and placeholder args like "<alias>" are left for the reader to resolve.

4 / 5

Workflow Clarity

Six clearly sequenced steps with an explicit validation step (Step 4), a validate→remediate→re-validate feedback loop with an escalation cap (Step 5, "Cap this at around 5 attempts — if still failing, present the YAML with the remaining errors"), and a pre-deploy confirmation checklist (Step 5.5). This matches anchor 5's explicit validation, feedback loops, and checklists; not 4 because no checkpoints are missing.

5 / 5

Progressive Disclosure

A References section with one-line annotations plus point-of-use citations in Steps 3 and 5, one level deep — good structure. However, references live at "../../references/orchestra/pipeline/yaml-authoring.md" — outside the skill directory rather than in a conventional bundled references/ folder (no bundle files exist alongside this SKILL.md) — a minor organization/navigation gap that fits anchor 4 rather than 5.

4 / 5

Total

17

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An excellent description: concrete actions, explicit what-and-when with natural trigger phrases, extensions, and directory triggers. The only weakness is the loosely bounded "similar pipeline directories" catch-all, which slightly widens conflict risk beyond the Orchestra niche.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "Create, validate, and remediate Orchestra pipeline definitions", "build a new pipeline", "add tasks to an existing pipeline", "fix pipeline validation errors", "author Orchestra workflow definitions" — with comprehensive coverage of the skill's domain in both YAML and OML. Anchor 5 fits; anchor 4 would require minor coverage gaps, and none are evident.

5 / 5

Completeness

Explicitly answers "what" ("Create, validate, and remediate Orchestra pipeline definitions, as YAML or OML") and "when" with concrete trigger phrases ("Use when asked to build a new pipeline… Trigger on phrases like…"). This mirrors the anchor-5 example structure; it is not 4 because the "when" clause is fully explicit rather than merely present.

5 / 5

Trigger Term Quality

Covers natural user phrasings ("create a pipeline", "add a dbt task", "write orchestra yaml", "fix validate errors"), synonyms (yaml/OML, pipeline/workflow), file extensions (.yml, .yaml, .oml), and directory-based triggers ("orchestra/ or similar pipeline directories"). Matches anchor 5's comprehensive coverage including synonyms and extensions.

5 / 5

Distinctiveness Conflict Risk

"Orchestra pipeline definitions" is a clear product niche with orchestra-specific trigger phrases, but "or when editing .yml, .yaml or .oml files under orchestra/ or similar pipeline directories" leaves the directory scope loosely bounded, creating minor overlap risk with generic YAML/pipeline-tool skills. Anchor 4 (mostly distinct, minor overlap) fits better than anchor 5's minimal conflict risk.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
orchestra-hq/orchestra-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.