Public Repository

Last pushed: a year ago
Short Description
Image with spark 1.6.0 and mesos 0.27.0 installed
Full Description

Docker image made to dockerize Spark driver and executors in Mesos.

  1. Submit a job to a mesos cluster using this image:
docker run -it --rm \
       --net=host \
       -v $JOB_FILE_PATH:/python:ro \
       -e SPARK_IMAGE=$SPARK_IMAGE \
       -e SPARK_MASTER=$SPARK_MASTER \
       $SPARK_IMAGE \
       sh -c "bin/spark-submit \
       --master ${SPARK_MASTER} \
       --deploy-mode client \
       /python/${JOB}.py $@"
Docker Pull Command
Owner
wumuxian