bibinwilson/docker-spark repository overview

⁠docker-spark

Docker container for running spark cluster.

⁠Building The Image:

docker build -t username/spark .

⁠Deploying Spark Master

docker run -d -t -P --name spark_master bibinwilson/docker-spark /start-master.sh "$@"

⁠Deploying Spark Worker

docker run -d -t -P --link spark_master:spark_master bibinwilson/docker-spark /start-worker.sh "$@"

⁠Deploying Spark shell

docker run -i -t -P --link spark_master:spark_master bibinwilson/docker-spark /spark-shell.sh "$@"