Apache Kafka Connectors - The Open Source Depot for Apache Kafka Integration Connectors

Red Hat has created this curated list of open source Apache Kafka connectors that enable integrations with your local systems landscape.

Get Started with AMQ streams Search Connectors List

Kafka Connect

Kafka Connect API

Kafka Connect is a tool for developers to stream data between Apache Kafka and external systems. It provides a framework for moving large amounts of data into and out of Kafka clusters while maintaining scalability and reliability. Kafka Connect is typically used to integrate Kafka with external databases, storage and messaging systems. Developers can also use Kafka Connect to build connector plug-ins (as JAR files) for their Kafka cluster and run connectors.

AMQ Streams allows developers to use the Cluster Operator to deploy Kafka Connect or Kafka Connect Source-2-Image (S2I) cluster to their OpenShift clusters.

Learn more

Customize your response to real-time information and increase your throughput

Not a developer? Learn more about how EDA can help your business move forward.

Apache Kafka has become the de facto standard for asynchronous event propagation between microservices. Things get challenging, though, when adding a service’s database to the picture: How can you avoid inconsistencies between Kafka and the database?

Enter change data capture (CDC) and Debezium.

By capturing changes from the log files of the database, Debezium gives you both reliable and consistent inter-service messaging via Kafka and instant read-your-own-write semantics for services themselves.

Get started in Change Data Capture with Debezium

Apache Kafka is a distributed data streaming platform that is a popular event processing choice. It can handle publishing, subscribing to, storing, and processing event streams in real-time. Apache Kafka supports a range of use cases where high throughput and scalability are vital, and by minimizing the need for point-to-point integrations for data sharing in certain applications, it can reduce latency to milliseconds.

More about Apache Kafka

What is the Camel Kafka Connector project?

After maturing for almost a decade, the Camel community spun a couple of sub-projects to foster innovation in areas like runtime support and container readiness. In particular, the Camel Kafka Connector sub-project focuses on the use of Camel components as Kafka Connect connectors. With this in mind, they built a tiny layer between Camel and Kafka frameworks to easily use each Camel component as a Kafka connector that can be utilized effortlessly in the Kafka ecosystem.

This project’s first release allows the community to try and share feedback on the autogenerated connectors. Despite being the first release of this sub-project, most of the underlying Camel components are battle-tested and employed all around the world in production scenarios.

Event-Driven Resources

Article

Simplify load balancing for API gateways using Red Hat 3scale API Management

Follow these steps to set up a load balancer on a Red Hat OpenShift instance in as little as ten minutes with Red Hat 3scale API Management.

How To

How to secure Apache Kafka schemas with Red Hat Integration Service Registry 2.0

Find out what's new in Red Hat Integration Service Registry 2.0, then use the new single sign-on feature to secure your registry using OpenID Connect.

Article

Managing the API life cycle in an event-driven architecture: A practical approach

Learn an API-driven, contract-first way to manage the application life cycle with Red Hat Integration Service Registry 2.0, Apache Kafka, and Spring Boot.

Article

How to expose a WebSocket endpoint using Red Hat 3scale API Management

This quick tip shows you how to use Red Hat 3scale API Management to configure a WebSocket server and expose the server endpoint on API Gateway.