Tools for installing Connect plugins
2.6K
The Container image contains tools for installing Connect plugins like Connectors to the ueisele/apache-kafka-connect-base, ueisele/apache-kafka-connect and ueisele/apache-kafka-connect-standalone images.
The connect/Containerfile can be used as an example.
The Container images are available on Docker Hub repository ueisele/apache-kafka-connect-plugin-install, and the source files for the images are available on GitLab repository ueisele/kafka-images.
The Container images are based on ueisele/zulu-openjdk-micro with JRE installed (e.g. 20-jre).
The OpenJDK image in turn is based on AlmaLinux 9 Micro.
As OpenJDK Azul Zulu is used. Azul Zulu builds of OpenJDK are fully tested and TCK compliant builds of OpenJDK.
The Container image supports installation of Kafka Connect plugins like connectors during startup with multiple methods.
The plugins are installed by default to the /opt/apache/kafka/plugins directory. This can be changed with the environment variable PLUGIN_INSTALL_DIR.
Install plugin from Confluent Hub:
connect-plugin-install --confluent-hub-ids "confluentinc/kafka-connect-json-schema-converter:7.4.0"
Install plugins from URL:
connect-plugin-install --urls \
https://github.com/castorm/kafka-connect-http/releases/download/v0.8.11/castorm-kafka-connect-http-0.8.11.zip \
https://github.com/RedHatInsights/expandjsonsmt/releases/download/0.0.7/kafka-connect-smt-expandjsonsmt-0.0.7.tar.gz
Install additional libraries to directory:
connect-plugin-install \
--confluent-hub-ids \
confluentinc/kafka-connect-avro-converter:7.4.0 \
--lib-urls \
confluentinc-kafka-connect-avro-converter/lib=https://repo1.maven.org/maven2/com/google/guava/guava/30.1.1-jre/guava-30.1.1-jre.jar \
confluentinc-kafka-connect-avro-converter/lib=https://repo1.maven.org/maven2/com/google/guava/failureaccess/1.0.1/failureaccess-1.0.1.jar
In order to create your own Container image clone the ueisele/kafka-image Git repository and run the build command:
git clone https://gitlab.com/ueisele/kafka-images.git
cd kafka-images
connect-plugin-install/build.sh --build
The connect-plugin-install/build.sh script provides the following options:
Usage: connect-plugin-install/build.sh [--build] [--push] [--registry docker.io] [--user ueisele] [--archs amd64,arm64] [--openjdk-release 20] [--openjdk-version 20.0.1]
This Container image is licensed under the Apache 2 license.
Content type
Image
Digest
sha256:94fd61a27…
Size
97 MB
Last updated
almost 3 years ago
docker pull ueisele/apache-kafka-connect-plugin-install