Apache Samza
Apache Samza is a distributed stream processing framework developed at LinkedIn and later open-sourced under the Apache Software Foundation. It is designed for real-time, fault-tolerant, stateful processing of data streams, tightly integrating with Apache Kafka for messaging and Apache YARN for…
Key facts
- First appeared
- 2013
- Category
- technology
- Problem solved
- Apache Samza was created to address the critical need for a scalable, fault-tolerant, and stateful stream processing framework capable of handling the massive data volumes generated at companies like LinkedIn. Before Samza, organizations often relied on batch processing systems like Hadoop MapReduce for analytical tasks, which introduced significant latency. Real-time processing was either rudimentary, lacked robust state management, or wasn't designed for distributed, fault-tolerant execution at scale, making it challenging to build applications that required immediate insights and reactions to live data streams.
- Platforms
- JVM (Java Virtual Machine), Windows (for development), Linux, macOS