Apache Spark Project Initiation at UC Berkeley AMPLab

Matei Zaharia began development on Apache Spark as a research project during his PhD at UC Berkeley's AMPLab, aiming to create a faster, more general-purpose cluster computing system than Hadoop MapReduce.

Significance

This marked the birth of Spark, laying the foundational technology for what would become a cornerstone of big data analytics and the basis for Databricks.

Key facts

Date
2009-11-01
Type
invention
Location
UC Berkeley, California, USA