Sign inSign up

ipasstw/hudi-spark

By ipasstw

•Updated over 3 years ago

The base image for hudi running on Kubernetes with spark-operator.

Image
0

109

ipasstw/hudi-spark repository overview

Based on the latest spark-operator image. (https://github.com/GoogleCloudPlatform/spark-on-k8s-operator⁠)

Build with Apache Hudi version 0.12.2 (Scala 2.12), including some Hudi bug fixes which are not yet committed the changes to the Apache Hudi project (https://hudi.apache.org/⁠).

Release notes:

  • 0.0.1: Implemented support for using SQLServer as the Debezium datasource.with org.apache.hudi.utilities.sources.debezium.SqlserverDebeziumSource.
  • 0.0.2: Fixed bugs related to receiving empty data when all messages are ingested in the transformer.

Tag summary

Content type

Image

Digest

sha256:7bd5df0b1…

Size

764.5 MB

Last updated

over 3 years ago

docker pull ipasstw/hudi-spark:0.0.2