Initial Prototype Development

Matei Zaharia, a Ph.D. student, begins developing Spark as a research project to address the inefficiencies of Hadoop MapReduce for iterative workloads.

Significance

This marked the genesis of Spark, born out of a direct need to solve a critical performance problem in big data processing.

Key facts

Year
2009
Type
invention
Location
UC Berkeley AMPLab