Spark: Cluster Computing with Working Sets Paper & Open Source Release

Matei Zaharia and the AMPLab team presented their seminal paper on Spark, detailing its in-memory, iterative processing capabilities, and simultaneously released the codebase as open-source.

Significance

This event marked the public debut of Spark, showcasing its foundational RDD concept and demonstrating its orders-of-magnitude performance improvement over MapReduce for iterative workloads, drawing immediate attention from the big data community.

Key facts

Date
2010-06-08
Type
invention
Location
Boston, Massachusetts (USENIX HotCloud 2010)