Apache Spark Project Initiated at AMPLab

Matei Zaharia begins developing Apache Spark as a research project during his Ph.D. studies, aiming to address the limitations of Hadoop MapReduce for iterative and interactive workloads.

Significance

This marked the birth of Spark, laying the fundamental architectural design for fast, in-memory distributed data processing that would eventually become the core of Databricks' offerings.

Key facts

Date
2009-11-01
Type
invention
Location
UC Berkeley AMPLab, Berkeley, California