Matei Zaharia begins Spark development
Matei Zaharia, a Ph.D. student at UC Berkeley's AMPLab, starts developing Spark as a research project to address the shortcomings of Hadoop MapReduce for iterative and interactive workloads.
Significance
This marks the conceptual birth of Spark, driven by a clear understanding of MapReduce's limitations and a vision for a more versatile and performant distributed computing engine.
Key facts
- Year
- 2009
- Type
- invention
- Location
- University of California, Berkeley