Apache Spark Common Utils library providing core utilities and shared functionality for distributed computing operations

Catalyst is a library for manipulating relational query plans within Apache Spark SQL

Catalyst is a library for manipulating relational query plans used as the foundation for Spark SQL's query optimizer and execution engine

Bagel is a Spark implementation of Google's Pregel graph processing framework, deprecated and superseded by GraphX

Apache Spark SQL connector for reading and writing Avro data with comprehensive serialization capabilities

CLI and programmatic API for adding UI components from registries. Supports multi-registry, dependency resolution, code transformation, and MCP integration for AI assistants.

Apache Flink Mesos integration module that provides resource manager implementation for running Flink clusters on Apache Mesos.

Distributed SQL query engine for Apache Spark with DataFrame/Dataset APIs, comprehensive SQL functions, streaming capabilities, and data source connectors

Kafka 0.10+ Source for Structured Streaming providing Kafka integration for Apache Spark's streaming and batch processing

Testing utilities for Apache Flink stream processing framework providing test environments, base classes and sample data

Comprehensive Table/SQL distribution for Apache Flink with Blink planner for optimized table processing in both batch and streaming modes.

Apache Flink input format library for parsing Twitter JSON data into structured Tweet objects for stream processing applications

Comprehensive integration test suite for Apache Flink stream processing framework providing test utilities, base classes, and infrastructure for validating fault tolerance, checkpointing, and streaming operations.

Test utilities library for Apache Flink applications providing streaming environments, test data sources, result collection mechanisms, and metrics testing utilities.

Runtime classes required by a task manager for execution of table programs in Apache Flink's Blink planner

Apache Flink Table Planner - translates and optimizes table programs into Flink pipelines

Flink Table Planner connects Table/SQL API and runtime, responsible for translating and optimizing table programs into Flink pipelines.

Scala API for Apache Flink's Table & SQL ecosystem with type-safe bindings and comprehensive support for Scala-specific types

Apache Flink Streaming Scala API provides elegant and fluent Scala APIs for building high-throughput, low-latency stream processing applications with fault-tolerance and exactly-once processing guarantees

Apache Flink Scala API for DataStream processing with type-safe, functional programming constructs for building streaming data processing applications.