Apache Kafka Connectors - The Open Source Depot for Apache Kafka Integration Connectors
Red Hat has created this curated list of open source Apache Kafka connectors that enable integrations with your local systems landscape.
Kafka Connect API
Kafka Connect is a tool for developers to stream data between Apache Kafka and external systems. It provides a framework for moving large amounts of data into and out of Kafka clusters while maintaining scalability and reliability. Kafka Connect is typically used to integrate Kafka with external databases, storage and messaging systems. Developers can also use Kafka Connect to build connector plug-ins (as JAR files) for their Kafka cluster and run connectors.
AMQ Streams allows developers to use the Cluster Operator to deploy Kafka Connect or Kafka Connect Source-2-Image (S2I) cluster to their OpenShift clusters.
Customize your response to real-time information and increase your throughput
Not a developer? Learn more about how EDA can help your business move forward.
Kafka and Debezium
Apache Kafka has become the de facto standard for asynchronous event propagation between microservices. Things get challenging, though, when adding a service’s database to the picture: How can you avoid inconsistencies between Kafka and the database?
Enter change data capture (CDC) and Debezium.
By capturing changes from the log files of the database, Debezium gives you both reliable and consistent inter-service messaging via Kafka and instant read-your-own-write semantics for services themselves.
How do I run Kafka on Kubernetes?
Apache Kafka is a distributed data streaming platform that is a popular event processing choice. It can handle publishing, subscribing to, storing, and processing event streams in real-time. Apache Kafka supports a range of use cases where high throughput and scalability are vital, and by minimizing the need for point-to-point integrations for data sharing in certain applications, it can reduce latency to milliseconds.
What is the Camel Kafka Connector project?
After maturing for almost a decade, the Camel community spun a couple of sub-projects to foster innovation in areas like runtime support and container readiness. In particular, the Camel Kafka Connector sub-project focuses on the use of Camel components as Kafka Connect connectors. With this in mind, they built a tiny layer between Camel and Kafka frameworks to easily use each Camel component as a Kafka connector that can be utilized effortlessly in the Kafka ecosystem.
This project’s first release allows the community to try and share feedback on the autogenerated connectors. Despite being the first release of this sub-project, most of the underlying Camel components are battle-tested and employed all around the world in production scenarios.
Event-Driven Resources
Article
Dec 12, 2024
What’s new in Red Hat build of Apache Camel 4.8
Red Hat build of Apache Camel 4.8 brings enhancements in contract-first API...
Article
Sep 25, 2024
Why internal developer portals matter
The first article in a series exploring the journey of building an IDP using...
Article
Sep 11, 2024
Kuadrant joins CNCF as a sandbox project
The Kuadrant open source project helps platform engineers and developers...
Article
Jun 12, 2024
Getting started with Red Hat Connectivity Link on OpenShift
Learn how to get started with Red Hat Connectivity Link, which provides...
