Sign inSign up

tabulario/iceberg-rest

By tabulario

Updated about 2 years ago

Sample REST image for experimentation and testing with Iceberg RESTCatalog implementations

Image
2

1M+

tabulario/iceberg-rest repository overview

Overview

This image provides a thin server to expose an Iceberg RESTCatalog server-side implementation backed by an existing catalog implementation.

Note: This is is a reference implementation that can be leveraged for experimentation or building a custom implementation.

Github Repo

Example Configurations

Default Configuration (In Memory JdbcBackend)

Running the container by default will expose a REST server on port 8181

The backing catalog is the Iceberg JdbcCatalog implementation with sqlite database.

docker pull tabulario/iceberg-rest:latest
docker run -p 8181:8181 tabulario/iceberg-rest:latest

Glue Configuration

docker run \
    -e AWS_REGION=us-west-2 \
    -e AWS_ACCESS_KEY_ID=<key_id>
    -e AWS_SECRET_ACCESS_KEY=<access_key> \
    -e CATALOG_CATALOG__IMPL=org.apache.iceberg.aws.glue.GlueCatalog \
    -p 8181:8181 \
    tabulario/iceberg-rest:0.1.0

Connecting Engines

Spark Configuration

Requires: Spark with Iceberg 0.14.1 Runtime

# REST Environment
spark.sql.catalog.rest                    org.apache.iceberg.spark.SparkCatalog
spark.sql.catalog.rest.catalog-impl       org.apache.iceberg.rest.RESTCatalog
spark.sql.catalog.rest.uri                http://0.0.0.0:8181/

Tag summary

Content type

Image

Digest

sha256:3b7d31bdf

Size

246.7 MB

Last updated

about 2 years ago

docker pull tabulario/iceberg-rest