Kafka's Internal Development Begins at LinkedIn

Jay Kreps, Neha Narkhede, and Jun Rao begin designing and implementing Kafka internally at LinkedIn to address the company's massive data pipeline challenges.

Significance

This marked the birth of Kafka, born out of necessity to manage LinkedIn's ever-growing, real-time data streams for operational monitoring, activity feeds, and analytics.

Key facts

Date
2008-09-01
Type
invention
Location
LinkedIn, Mountain View, California