Spark Project Initiation

Matei Zaharia begins the development of Spark as a research project during his Ph.D. studies, aiming to address the limitations of MapReduce for iterative and interactive workloads.

Significance

This marks the conceptual birth of Spark, driven by a clear need for a more efficient and flexible big data processing engine.

Key facts

Date
2009-01-01
Type
invention
Location
UC Berkeley AMPLab, Berkeley, California