Internal Incubation at Uber

Vinoth Chandar and his team at Uber began building Hudi internally to address the critical need for efficient upserts and deletes on their massive Hadoop data lake, struggling with petabytes of data and strict compliance requirements.

Significance

This marked the genesis of Hudi, born out of a real-world, high-scale operational necessity, demonstrating its capabilities under extreme pressure before public release.