Apache Spark - Unified analytics engine for large-scale data processing

PySpark Streaming module that enables scalable, high-throughput, fault-tolerant stream processing of live data streams in Python

YARN auxiliary service for Apache Spark shuffle operations that provides external shuffle service functionality in YARN environments

Apache Spark network common library providing networking abstractions and utilities for distributed computing

Core networking library for Apache Spark providing transport layer abstractions and utilities

Core networking infrastructure for Apache Spark cluster computing with transport layer, RPC, chunk fetching, and SASL authentication

Spark Project ML Local Library provides local (non-distributed) linear algebra utilities and basic machine learning components.

Apache Spark's scalable machine learning library providing comprehensive ML algorithms and utilities for large-scale data processing

Apache Mesos cluster manager integration for Apache Spark enabling distributed computation on Mesos clusters.

Spark ML Local Library providing linear algebra and statistical utilities for local machine learning operations without requiring a distributed Spark cluster

Library for launching Spark applications programmatically

GraphX is Apache Spark's API for graphs and graph-parallel computation

Ganglia metrics reporting integration for Apache Spark monitoring systems

Apache Spark Core provides distributed computing capabilities with RDDs, task scheduling, and cluster management for big data processing

Core utility classes and functions for Apache Spark including exception handling, logging, storage configuration, and Java API integration

Catalyst query optimization framework and expression evaluation engine for Apache Spark SQL

Catalyst is Spark's library for manipulating relational query plans and expressions

Apache Spark Avro connector provides seamless integration between Apache Spark SQL and Apache Avro data format with automatic schema evolution support and built-in compression capabilities

Core server component of Apache SkyWalking APM system providing distributed tracing, monitoring, and observability capabilities for microservices and cloud-native architectures.

Web support module for Apache Shiro providing servlet filters, session management, and web-specific authentication and authorization features