Initial Prototype Development
Matei Zaharia, a Ph.D. student, begins developing Spark as a research project to address the inefficiencies of Hadoop MapReduce for iterative workloads.
Significance
This marked the genesis of Spark, born out of a direct need to solve a critical performance problem in big data processing.
Key facts
- Year
- 2009
- Type
- invention
- Location
- UC Berkeley AMPLab