Project "Spectre" Internal Inception at Netflix

Ryan Blue and Daniel Weeks began internal development of a new table format, codenamed 'Spectre', to address the limitations of Apache Hive at Netflix's extreme scale.

Significance

This marked the birth of Iceberg's core concepts and architecture, driven by real-world, large-scale production challenges.

Key facts

Year
2017
Type
invention
Location
Netflix, Los Gatos, California