Apache Spark Genesis at AMPLab

Matei Zaharia begins developing Apache Spark as a research project, aiming to overcome Hadoop's limitations for iterative and interactive workloads.

Significance

This marked the initial conceptualization of a high-performance, in-memory computation engine that would become the foundation for Databricks and the Lakehouse vision.