Spark: Cluster Computing with Working Sets Paper & Open Source Release
Matei Zaharia and the AMPLab team presented their seminal paper on Spark, detailing its in-memory, iterative processing capabilities, and simultaneously released the codebase as open-source.
Significance
This event marked the public debut of Spark, showcasing its foundational RDD concept and demonstrating its orders-of-magnitude performance improvement over MapReduce for iterative workloads, drawing immediate attention from the big data community.
Key facts
- Date
- 2010-06-08
- Type
- invention
- Location
- Boston, Massachusetts (USENIX HotCloud 2010)