Public | Automated Build

Last pushed: 2 years ago
Short Description
Short description is empty for this repo.
Full Description

docker-spark-job-server

Runs nickpoorman/docker-spark-postgresql-base Docker image.

Note: It's actual parent is nickpoorman/docker-mesos so that we have the mesos lib included.

This container should be used to run a Spark Job Server and packaged with everything the master needs.

To make this easier, supply a url to fetch your custom conf.

The environment should be specified with Docker's -e switch.

After setup this "essentially" runs the start script customized for the Dockerfile.

example

docker -H tcp://${HOST_IP_0}:2375 run -it \
    --net=host \
    -e APP_USER=root \
    -e APP_GROUP=root \
    -e SCALA_VERSION=2.10.5 \
    -e SPARK_HOME=/spark \
    -e SPARK_CONF_DIR=/spark/conf \
    -e INSTALL_DIR=/job-server \
    -e JOB_SERVER_CONFIG_URI=https://raw.githubusercontent.com/nextglass/spark-jobserver/master/job-server/config/local.conf.template \
    -p 8090:8090 \
    -p 9999:9999 \
    nickpoorman/docker-spark-job-server
Docker Pull Command
Owner
urlgrey
Source Repository