Apache Spark Project Start

Matei Zaharia began the Apache Spark project as a research initiative at UC Berkeley's AMPLab, aiming to create a faster, more general-purpose engine for large-scale data processing than Hadoop MapReduce.

Significance

Spark became the foundational compute engine upon which Databricks built its platform and which underpinned the Lakehouse vision.