Initial conceptualization of 'NextGen MapReduce' (YARN)
Internal discussions and preliminary design work began at Yahoo! to address the limitations of Hadoop MapReduce 1.x, aiming to separate resource management from the MapReduce programming model. This was driven by the core team including Arun Murthy and Mahadev Konar.
Significance
This marked the true genesis of YARN, moving beyond mere dissatisfaction with MR1 to actively proposing a fundamental architectural overhaul.
Key facts
- Date
- 2010-09-01
- Type
- invention
- Location
- Yahoo! Research, Santa Clara, CA, USA