Initial Development at LinkedIn

Engineers at LinkedIn began developing Samza internally to address the need for real-time, stateful stream processing on their massive data infrastructure, leveraging Apache Kafka and YARN.

Significance

This internal development phase proved the viability and power of Samza's architecture, demonstrating its ability to handle LinkedIn's demanding real-time analytics needs.