Databricks Lakehouse

The Databricks Lakehouse is an open, unified data management architecture that combines the best features of data lakes and data warehouses. It provides data reliability, strong governance, and performance traditionally associated with data warehouses, directly on cost-effective, flexible data…

Key facts

First appeared: 2020
Category: technology
Problem solved: The Lakehouse architecture was created to eliminate data silos and complexity arising from the traditional 'Great Divide' between data lakes and data warehouses. It addresses issues like data quality, governance, and the inability to run diverse workloads (BI, ML, streaming) on a single, consistent copy of data without complex ETL processes or data duplication.
Platforms: Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure

Related technologies

Apache Spark
MLflow
Scala
Data Science Frameworks (e.g., scikit-learn, TensorFlow)
Python
AWS S3
Delta Lake
Unity Catalog
BI Tools (e.g., Tableau, Power BI)
Google Cloud Storage
SQL
Azure Data Lake Storage Gen2

Notable users

HP
Regeneron Pharmaceuticals
Credit Suisse
H&M
AstraZeneca
Comcast
Shell
Rivian