CtrlK
BlogDocsLog inGet started
Tessl Logo

dagster-definitions-to-orchestra

Use this skill when converting any Dagster job/schedule/Definitions to Orchestra YAML to handle top-level configuration. Triggers: any Dagster code containing ScheduleDefinition, @schedule, build_schedule_from_partitioned_job, RetryPolicy, op/run concurrency limits, run tags (dagster/max_runtime), Config classes, EnvVar, or Definitions. Must be applied before converting individual assets/ops — it establishes the pipeline root fields that wrap all task conversions.

70

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality, conversion-focused body: nearly everything is concrete, executable, and grounded in real validator behavior, with a clear rule-of-thumb and checklist. Its weaknesses are moderate duplication between the mapping sections and Gotchas, a missing explicit 'validate the output against /pipelines/schema' step, and a monolithic single-file layout where reference material is inlined.

Suggestions

Add an explicit final step to the Conversion Checklist: validate the generated root YAML against Orchestra's /pipelines/schema endpoint before handing off to task-level conversion — the skill already documents that validator and its error messages, so the feedback loop is one line away.

Deduplicate the Gotchas section against the field-mapping tables (the 6-field cron rule, the delay seconds-to-minutes conversion, and the tags-on-stage rejection each appear three times) — keep each rule in one authoritative place and reference it from the checklist.

Move the full before/after example and the exhaustive field-mapping tables into a references/ file (e.g. references/field-mapping.md), keeping SKILL.md as a lean overview with well-signaled one-level-deep pointers.

DimensionReasoningScore

Conciseness

The body is dense and assumes Claude's competence (no padding explaining what Dagster or cron are), but several key rules are repeated verbatim three times across the mapping tables, the checklist, and Gotchas — e.g. the 6-field cron rule, 'RetryPolicy.delay is seconds... divide by 60', and the tags-on-stage rejection. That is 'efficient; minor instances of over-explanation that could be trimmed' (4) rather than 5's 'every token earns its place', but tighter than the 3 anchor's 'some unnecessary explanation'.

4 / 5

Actionability

Exact field-mapping tables, executable Dagster Python and Orchestra YAML snippets, real validator error messages ('Incorrect number of values ... 6 required, 5 provided', 'extra_forbidden'), a numeric conversion rule with a cap (delay/60, clamp at 120), and a complete before/after example. Fully executable guidance covering the common cases — the 5 anchor; the 4 anchor would imply missing details, and none are apparent.

5 / 5

Workflow Clarity

Sequence is explicit ('Apply this skill first, before any asset/op-level conversion'), the Conversion Checklist enumerates checkpoints including manual-review flags for partitions/backfills, and the before/after example grounds the process. It falls short of 5 because the skill documents Orchestra's /pipelines/schema validator and its error strings but never instructs the converter to validate the produced YAML — a checkpoint that is implied rather than explicit, matching 'clear sequence with most checkpoints present; minor validation gaps'.

4 / 5

Progressive Disclosure

No bundle files exist; the single-file body is well organized (Overview → Field Mapping → Checklist → Example → Gotchas → References), with clearly signaled cross-skill pointers and external links collected under References. This is good structure with most content appropriately placed (4) rather than 5: at ~200 lines, the full field-mapping tables and the complete before/after example could be split one level deep into reference files to keep SKILL.md a lean overview.

4 / 5

Total

17

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete, third-person, and explicit about both what it does and when to use it, with an unusually specific trigger list of Dagster API names. The only weaknesses are minor — a few missing natural trigger terms (sensors, @job, RunRequest) and slight overlap risk with sibling Dagster-to-Orchestra conversion skills.

DimensionReasoningScore

Specificity

Quotes concrete actions: 'converting any Dagster job/schedule/Definitions to Orchestra YAML to handle top-level configuration' and 'establishes the pipeline root fields that wrap all task conversions', plus a comprehensive list of the exact Dagster constructs handled (schedules, retries, concurrency limits, run tags, Config classes, EnvVar, Definitions). This matches the 'multiple specific concrete actions; comprehensive coverage' anchor rather than the 4 anchor, whose distinguishing trait is 'minor gaps in coverage'.

5 / 5

Completeness

Explicitly answers both questions: what ('converting any Dagster job/schedule/Definitions to Orchestra YAML to handle top-level configuration') and when ('Use this skill when...', 'Triggers: any Dagster code containing...'), and adds ordering guidance ('Must be applied before converting individual assets/ops'). This is the 5 anchor verbatim in structure; it is not the 4 anchor because 'when' is fully explicit with concrete trigger phrases, not merely improvable.

5 / 5

Trigger Term Quality

Strong natural triggers a user would actually say: 'ScheduleDefinition, @schedule, build_schedule_from_partitioned_job, RetryPolicy, op/run concurrency limits, run tags (dagster/max_runtime), Config classes, EnvVar, or Definitions'. A few natural terms are missing (sensors, @job, RunRequest), which fits the 4 anchor ('good keyword coverage; a few natural terms missing') rather than the 5 anchor's 'comprehensive coverage... including synonyms'.

4 / 5

Distinctiveness Conflict Risk

A clear niche (Dagster-to-Orchestra migration, pipeline-root configuration) with highly distinct API-name triggers, but 'EnvVar' and 'Definitions' could also fire the sibling skills the body itself references (dagster-connections-to-orchestra, dagster-alerts-to-orchestra). Fits 'mostly distinct; minor overlap risk with closely related skills' rather than the 5 anchor, which demands minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
orchestra-hq/orchestra-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.