Overview

This skill converts Prefect prefect_airbyte tasks targeting a self-hosted Airbyte Server (any host other than api.airbyte.com) into Orchestra pipeline tasks using integration: AIRBYTE_SERVER and integration_job: AIRBYTE_SERVER_JOB. It covers sync and reset job types.

Parameter Mapping

Orchestra YAML Structure

integration: AIRBYTE_SERVER
integration_job: AIRBYTE_SERVER_JOB
name: sync-task
connection: airbyte_server_prod_12345
parameters:
  connection_id: 'a1b2c3d4-e5f6-7890-abcd-ef1234567890'
  job_type: sync
depends_on: []
condition: null
tags: []

Conversion Steps

• Confirm the Prefect block's airbyte_server_host is NOT api.airbyte.com — if it is, use airbyte-cloud-prefect-to-orchestra
• Set integration: AIRBYTE_SERVER
• Set integration_job: AIRBYTE_SERVER_JOB
• Copy the connection_id UUID verbatim into parameters.connection_id
• Map reset_cache=True → parameters.job_type: reset; otherwise parameters.job_type: sync
• Set connection: to the Orchestra Airbyte Server connection slug — confirm its stored host URL matches the Prefect block's airbyte_server_host
• Set depends_on: from upstream task dependencies

Before / After Example

Prefect (before)

from prefect import flow, task
from prefect_airbyte.connections import AirbyteConnection
from prefect_airbyte.flows import trigger_sync_run_and_wait_for_completion

@flow
def sync_airbyte_server():
    airbyte_conn = AirbyteConnection.load("my-airbyte-server-block")
    # block points to https://airbyte.internal.example.com
    trigger_sync_run_and_wait_for_completion(
        airbyte_connection=airbyte_conn,
        connection_id="a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    )

Orchestra YAML (after)

version: v1
name: sync-airbyte-server
pipeline:
  stage-airbyte-sync:
    tasks:
      task-airbyte-sync:
        integration: AIRBYTE_SERVER
        integration_job: AIRBYTE_SERVER_JOB
        name: Sync Airbyte Server
        connection: airbyte_server_prod_12345
        parameters:
          connection_id: 'a1b2c3d4-e5f6-7890-abcd-ef1234567890'
          job_type: sync
        depends_on: []
        condition: null
        tags: []
    depends_on: []

Gotchas

• The UUID goes in parameters.connection_id, not on the connection: field — connection: is the Orchestra connection slug, not the Airbyte connection UUID
• Confirm the Orchestra Airbyte Server connection's stored host URL matches the Prefect block's airbyte_server_host; a mismatch will silently sync the wrong connection
• Host api.airbyte.com = Airbyte Cloud — use airbyte-cloud-prefect-to-orchestra instead
• AIRBYTE_SERVER_JOB polls internally — no separate sensor task needed
• job_type is required; omitting it will cause a validation error

References

• Orchestra Airbyte Server integration
• prefect-airbyte

Adding Alerts

See prefect-alerts-to-orchestra for all notification patterns.