Twitter feed receiver for Apache Spark Streaming that enables real-time consumption of Twitter data streams

Apache Spark Streaming integration with Amazon Kinesis for real-time processing of streaming data

Spark Streaming integration with Amazon Kinesis for real-time data processing using the Kinesis Client Library

Apache Spark Streaming integration library for consuming data from Amazon Kinesis streams with fault-tolerant checkpointing and automatic shard management

A shaded JAR assembly containing all dependencies needed for Kafka integration with Spark Streaming

Assembly JAR providing Apache Spark integration with Apache Kafka 0.10 for reliable distributed streaming data processing

Interactive Scala shell for Apache Spark enabling distributed data processing and analysis

Apache Spark interactive Scala shell (REPL) for Scala 2.10 providing read-eval-print loop interface for interactive data analysis and cluster computing.

Apache Spark is a unified analytics engine for large-scale data processing with high-level APIs in Scala, Java, Python, and R.

Apache Spark - Unified analytics engine for large-scale data processing

PySpark Streaming module that enables scalable, high-throughput, fault-tolerant stream processing of live data streams in Python

YARN auxiliary service for Apache Spark shuffle operations that provides external shuffle service functionality in YARN environments

Apache Spark network common library providing networking abstractions and utilities for distributed computing

Core networking library for Apache Spark providing transport layer abstractions and utilities

Core networking infrastructure for Apache Spark cluster computing with transport layer, RPC, chunk fetching, and SASL authentication

Spark Project ML Local Library provides local (non-distributed) linear algebra utilities and basic machine learning components.

Apache Spark's scalable machine learning library providing comprehensive ML algorithms and utilities for large-scale data processing

Apache Mesos cluster manager integration for Apache Spark enabling distributed computation on Mesos clusters.

Spark ML Local Library providing linear algebra and statistical utilities for local machine learning operations without requiring a distributed Spark cluster

Library for launching Spark applications programmatically