Apache Kafka Connect

Apache Kafka Connect is an open-source framework that serves as a centralized hub for streaming data between Apache Kafka and other data systems. It simplifies the process of integrating Kafka with databases, key-value stores, search indexes, and file systems through a pluggable and distributed…

Key facts

First appeared: 2015
Category: technology
Problem solved: Apache Kafka Connect was created to solve the significant operational burden and development overhead associated with integrating Apache Kafka with various external data sources and sinks. Before Connect, developers had to write custom, often redundant, application code (Kafka producers and consumers) for each specific integration, which was difficult to scale, manage, monitor, and maintain across an enterprise.
Platforms: Kubernetes, Docker, JVM (Java Virtual Machine), Windows, Linux, macOS

Related technologies

MySQL
ksqlDB
PostgreSQL
Apache Kafka
Apache Cassandra
Confluent Schema Registry
Apache Flink
Amazon S3
Elasticsearch
MongoDB
Apache Spark

Notable users

Uber
Confluent
Netflix
LinkedIn
Capital One
Goldman Sachs
Tesla
Spotify