tessl/pypi-kedro

Kedro helps you build production-ready data and analytics pipelines

Overall
score

98%

Overview

Eval results

Files

Data Pipeline Combiner

Name: tessl/pypi-kedro
Author: tessl

Build a utility that combines multiple data processing pipelines using composition operators.

Capabilities

Merge pipelines

Merging two pipelines with nodes A, B and nodes C, D produces a pipeline with all four nodes A, B, C, D @test

Subtract pipelines

Subtracting a pipeline with nodes B, C from a pipeline with nodes A, B, C produces a pipeline with only node A @test

Intersect pipelines

Intersecting a pipeline with nodes A, B, C and a pipeline with nodes B, C, D produces a pipeline with nodes B, C @test

Implementation

@generates

API

def merge_pipelines(pipeline1, pipeline2):
    """
    Merge two pipelines together. All nodes from both pipelines are included.

    Args:
        pipeline1: First pipeline to merge
        pipeline2: Second pipeline to merge

    Returns:
        A merged pipeline containing nodes from both input pipelines
    """
    pass

def subtract_pipelines(pipeline1, pipeline2):
    """
    Subtract pipeline2 from pipeline1.

    Args:
        pipeline1: Base pipeline
        pipeline2: Pipeline to subtract

    Returns:
        A pipeline containing nodes from pipeline1 that are not in pipeline2
    """
    pass

def intersect_pipelines(pipeline1, pipeline2):
    """
    Find the intersection of two pipelines.

    Args:
        pipeline1: First pipeline
        pipeline2: Second pipeline

    Returns:
        A pipeline containing only nodes that appear in both input pipelines
    """
    pass

Dependencies { .dependencies }

kedro { .dependency }

Provides pipeline construction and composition capabilities.

Install with Tessl CLI

npx tessl i tessl/pypi-kedro

tile.json