Sign inSign up

zero323/sparkr-build-sandbox

By zero323

•Updated over 6 years ago

Docker images for testing SparkR builds

Image
0

347

zero323/sparkr-build-sandbox repository overview

⁠Docker images for testing SparkR builds

⁠Building images

Run

docker build -f R_VERSION/Dockerfile .

using root of this repository as the context.

⁠Usage

Entry point takes following arguments

usage: entrypoint.py [-h] [--branch BRANCH] [--commit COMMIT]
                     [--action {build-and-test,resolve-dependencies}]
                     [--public-key PUBLIC_KEY]
                     user

positional arguments:
  user                  GitHub username

optional arguments:
  -h, --help            show this help message and exit
  --branch BRANCH       Branch to fetch
  --commit COMMIT       Commit hash
  --action {build-and-test,resolve-dependencies}
  --public-key PUBLIC_KEY
                        URL pointing to GPG key used to sign the commit

resolve-dependencies action can be used to prefetch Maven dependencies. The result can be committed and use a base for actual testing image.

⁠Rendering of new images

render.py script can be used to generate new Dockerfiles.

usage: render.py [-h] versions [versions ...]

positional arguments:
  versions    Must correspond to one of the tags from
              https://hub.docker.com/r/rocker/verse/tags

optional arguments:
  -h, --help  show this help message and exit

⁠Versions

Tag / R versionBased onOSJDKArrow
3.4.4rocker/verse:3.4.4Debian GNU/Linux Stretch80.15.1
3.5.3rocker/verse:3.5.3Debian GNU/Linux Stretch80.15.1
3.6.2rocker/verse:3.6.2Debian GNU/Linux Buster110.15.1

⁠Notes

Images published to Docker Hub⁠ are not automatically synced, to avoid possible dependency conflicts.

Tag summary

Content type

Image

Digest

Size

1.2 GB

Last updated

over 6 years ago

docker pull zero323/sparkr-build-sandbox:3.6.2