Apache HDFS
Apache HDFS (Hadoop Distributed File System) is a highly scalable, fault-tolerant distributed file system designed to run on commodity hardware. It is a core component of the Apache Hadoop ecosystem, optimized for storing and processing extremely large datasets, typically ranging into petabytes.
Key facts
- First appeared
- 2006
- Category
- technology
- Problem solved
- Apache HDFS was created to solve the problem of storing and processing extremely large datasets (petabytes) reliably and cost-effectively across clusters of commodity hardware, addressing the limitations of traditional network-attached storage or single-node file systems in terms of scale, fault tolerance, and throughput for batch processing.
- Platforms
- UNIX-like systems, Linux, Java Virtual Machine (JVM)
Related technologies
Notable users
- Hortonworks (now Cloudera)
- Cloudera
- Yahoo!