kduda/spark repository overview

⁠Apache Spark Docker cluster

⁠Docker Hub for this image⁠

Based on "A minimal Ubuntu base image modified for Docker-friendliness"⁠

⁠Supported tags and respective Dockerfile links

• jre-8_spark-2.1.0, latest (jre-8_spark-2.1.0/Dockerfile)⁠

⁠How to use this image

⁠start a single apache spark instance

$ docker run --name some-spark -d kduda/spark

This image exposes 8080 - 9090, 7077, 6066, 4040 ports.

⁠start a spark cluster with docker-compose up -d

• spark/docker-compose.yml⁠ - Spark Master and 4 workers
• spark-zeppelin/docker-compose.yml⁠ - Zeppelin with Spark Master and 4 workers