Apache Hadoop MapReduce

Apache Hadoop MapReduce is a software framework within the Apache Hadoop ecosystem that enables parallel processing of large datasets across clusters of commodity hardware. It allows developers to write programs that process massive amounts of unstructured and structured data in a distributed,…

Key facts

First appeared
2006
Category
technology
Problem solved
Apache Hadoop MapReduce was created to solve the challenge of processing extremely large datasets (terabytes to petabytes) efficiently and fault-tolerantly using inexpensive, commodity hardware. Before its advent, organizations struggled with the computational and storage demands of big data, often relying on expensive supercomputers, specialized high-performance clusters, or custom-built, brittle distributed systems that were difficult to scale and maintain.
Platforms
Linux, JVM (Java Virtual Machine), Unix-like operating systems

Related technologies

Notable users

  • Yahoo!
  • Netflix
  • Facebook
  • Twitter
  • eBay