Apache Hadoop

Apache Hadoop () is a collection of open-source software utilities for reliable, scalable, distributed computing. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model. Hadoop was originally designed for computer clusters built…

Key facts

First appeared: 2006
Category: technology
Problem solved: Apache Hadoop was created to address the challenges of reliably storing and processing massive datasets (petabytes and beyond) across large clusters of commodity hardware in a fault-tolerant and scalable manner, a task beyond the capabilities of traditional relational database management systems and single-node processing solutions.
Platforms: web, Linux, windows, linux, UNIX-like, unix

Related technologies

Apache HBase
Apache ZooKeeper
Apache Pig
Apache Kafka
Apache YARN
Apache Spark
Apache Flink
Apache Hive

Notable users

Google (Dataproc)
Microsoft (HDInsight)
Facebook
Many large enterprises with significant data volumes
eBay
Yahoo!
Amazon Web Services (EMR)
Netflix