MQTT receiver for Apache Spark Streaming that enables real-time processing of messages from MQTT brokers

Apache Spark Streaming integration with ZeroMQ message queue system for real-time data processing

Twitter feed receiver for Apache Spark Streaming that enables real-time consumption of Twitter data streams

Apache Spark Streaming integration with Amazon Kinesis for real-time processing of streaming data

Spark Streaming integration with Amazon Kinesis for real-time data processing using the Kinesis Client Library

Apache Spark Streaming integration library for consuming data from Amazon Kinesis streams with fault-tolerant checkpointing and automatic shard management

A shaded JAR assembly containing all dependencies needed for Kafka integration with Spark Streaming

Assembly JAR providing Apache Spark integration with Apache Kafka 0.10 for reliable distributed streaming data processing

Interactive Scala shell for Apache Spark enabling distributed data processing and analysis

Apache Spark interactive Scala shell (REPL) for Scala 2.10 providing read-eval-print loop interface for interactive data analysis and cluster computing.

Apache Spark connector for Protocol Buffer (protobuf) data format support, providing SQL functions to convert between binary protobuf data and Catalyst data structures for processing structured data in distributed big data analytics pipelines

Apache Spark is a unified analytics engine for large-scale data processing with high-level APIs in Scala, Java, Python, and R.

Apache Spark - Unified analytics engine for large-scale data processing

PySpark Streaming module that enables scalable, high-throughput, fault-tolerant stream processing of live data streams in Python

YARN auxiliary service for Apache Spark shuffle operations that provides external shuffle service functionality in YARN environments

Apache Spark network common library providing networking abstractions and utilities for distributed computing

Core networking library for Apache Spark providing transport layer abstractions and utilities

Core networking infrastructure for Apache Spark cluster computing with transport layer, RPC, chunk fetching, and SASL authentication

Spark Project ML Local Library provides local (non-distributed) linear algebra utilities and basic machine learning components.

Apache Spark's scalable machine learning library providing comprehensive ML algorithms and utilities for large-scale data processing