Kafka's Internal Inception at LinkedIn

Jay Kreps, Neha Narkhede, and Jun Rao began development of Kafka internally at LinkedIn to address severe data pipeline challenges.

Significance

This marked the birth of Kafka, a crucial step in transforming LinkedIn's data infrastructure and proving the concept of a distributed commit log for event streaming.

Key facts

Date
2010-01-01
Type
invention
Location
LinkedIn Headquarters, Mountain View, California