Apache Spark Project Initiated

Matei Zaharia begins developing Apache Spark as his Ph.D. project at UC Berkeley, aiming to create a faster, more general-purpose big data processing engine than Hadoop MapReduce.

Significance

This marks the conceptual birth of Spark, laying the groundwork for its core architecture and in-memory processing capabilities that would revolutionize big data analytics.

Key facts

Date
2009-10-01
Type
invention
Location
UC Berkeley AMPLab, Berkeley, California