Public | Automated Build

Last pushed: 18 days ago
Short Description
Run a Apache Spark standalone cluster from Docker container
Full Description

This repository contains a set of scripts and configuration files to run a Apache Spark standalone cluster from Docker container.

To run master execute:
docker run -d -t -P --name spark_master androw/spark /start-master.sh

To run worker execute:
docker run -d -t -P --link spark_master:spark_master androw/spark /start-worker.sh

You can run multiple workers. Every worker would be able to find master by it's container name "spark_master".

To run spark shell against this cluster execute:
docker run -i -t -P --link spark_master:spark_master androw/spark /spark-shell.sh

You can run multiple shells. Every shell would be able to find master by it's container name "spark_master".

Docker Pull Command
Owner
androw
Source Repository