Sign inSign up

fracorco/pyflink

By fracorco

•Updated over 2 years ago

Flink Docker image (amd64/arm64) with PyFlink and reduced logging

Image
0

421

fracorco/pyflink repository overview

Based on official Flink image⁠ and build instructions⁠ for PyFlink, with minor change (adding /opt/java/openjdk/include) to support linux/arm64 platform and reduced logging. Primarily meant to be used in this course⁠.

Dockerfile:

# The base flink image includes a JRE lacking the 'include' directory needed to install pemja==0.3.0 (for ARM)
COPY --from=eclipse-temurin:11.0.22_7-jdk-jammy /opt/java/openjdk/include /opt/java/openjdk/include

RUN apt-get update -y && \
    apt-get install -y python3 python3-pip python3-dev && \
    rm -rf /var/lib/apt/lists/* && \
    ln -s /usr/bin/python3 /usr/bin/python

RUN pip install -U pip && \
    pip install apache-flink==1.18.1 && \
    rm -Rf ~/.cache/

COPY ./log4j-console.properties /opt/flink/conf/log4j-console.properties

Built with:

$  docker buildx build --push --platform "linux/amd64,linux/arm64" -t fracorco/pyflink:1.18.1-scala_2.12-java11 .

Tag summary

Content type

Image

Digest

sha256:9513a995d…

Size

1001.1 MB

Last updated

over 2 years ago

docker pull fracorco/pyflink:1.18.1-scala_2.12-java11