Running Camel Kafka Connector for IBM Event Streams

Image by Ulli from Pixabay

Camel Kafka Connectors as a standard Kafka connector greatly increases the capability of integration of Kafka. There is about 164 connectors available as of now.

Let’s explore using these connectors with IBM Event Streams.

Build the Connector Image

Let’s build the connector image manually to have lesser magic and to separate the build and the running environment.

Download the Camel Kafka Connectors, see the file connector and the http source connector,

curl -LO https://repo.maven.apache.org/maven2/org/apache/camel/kafkaconnector/camel-file-kafka-connector/3.18.2/camel-file-kafka-connector-3.18.2-package.tar.gz
curl -LO https://repo.maven.apache.org/maven2/org/apache/camel/kafkaconnector/camel-http-source-kafka-connector/3.18.2/camel-http-source-kafka-connector-3.18.2-package.tar.gz

Create a directory, untar the files in this directory. Notice each connector will have its own directory from the tar file structure.

mkdir -p my-plugins
tar xf ../camel-file-kafka-connector-3.18.2-package.tar.gz
tar xf ../camel-http-source-kafka-connector-3.18.2-package.tar.gz

Login to the IBM registry with your entitlement, then build the image with the following Dockerfile,