Data Lakes

A Data Lake is a centralized repository designed to store vast amounts of raw data, in its native format, from various sources without a predefined schema. It enables organizations to ingest and hold structured, semi-structured, and unstructured data at scale and low cost, making it accessible…

Key facts

First appeared
2010
Category
technology
Problem solved
Data Lakes were created to address the challenges of storing and analyzing massive volumes of diverse data types—structured, semi-structured, and unstructured—at an economical cost, without requiring an upfront schema definition. This enabled advanced analytics and machine learning applications that traditional data warehouses, with their rigid schema-on-write approach, struggled to support efficiently or affordably.
Platforms
Cloud Platforms (AWS, Azure, Google Cloud, Snowflake), On-premises (Hadoop Distributed File System - HDFS)

Related technologies

Notable users

  • Amazon (AWS S3, Lake Formation)
  • Capital One
  • Netflix
  • Siemens
  • Microsoft (Azure Data Lake Storage, Synapse Analytics)
  • Shell
  • Google (Google Cloud Storage, BigQuery)