Hadoop
Apache Hadoop is an open-source framework designed for distributed storage and processing of very large datasets across clusters of commodity hardware. It provides a robust, scalable, and fault-tolerant foundation for big data analytics, primarily consisting of the Hadoop Distributed File System…
Key facts
- First appeared
- 2005
- Category
- technology
- Problem solved
- Hadoop was created to address the challenge of storing and processing massive volumes of data (petabytes to exabytes) in a cost-effective and scalable manner, utilizing readily available commodity hardware rather than expensive, specialized supercomputers or traditional enterprise data warehouses that struggled with unstructured data.
- Platforms
- Linux, Cloud environments (e.g., AWS EMR, Google Cloud Dataproc, Azure HDInsight), Unix-like operating systems
Related technologies
Notable users
- Yahoo! (early pioneer and primary developer)
- Cloudera (distribution vendor)
- Netflix
- Hortonworks (distribution vendor, later merged with Cloudera)
- Amazon (through AWS EMR)
- eBay