Apache Spark Project Initiated at AMPLab
Matei Zaharia begins developing Apache Spark as a research project during his Ph.D. studies, aiming to address the limitations of Hadoop MapReduce for iterative and interactive workloads.
Significance
This marked the birth of Spark, laying the fundamental architectural design for fast, in-memory distributed data processing that would eventually become the core of Databricks' offerings.
Key facts
- Date
- 2009-11-01
- Type
- invention
- Location
- UC Berkeley AMPLab, Berkeley, California