Local key/value store abstraction for Apache Spark with thread-safe operations, automatic serialization, and indexing capabilities