Builds on cdecl/hadoop-live with a single node spark cluster built with hive and yarn support.
This instance of spark is configured to bind to the eth0 ipv4 ip address.
Run with the below command to give you a bash session on a server running a spark cluster.
docker run -it --rm -p 8080:8080 -p 7077:7077 gsoertsz/hadoop-hive-spark -bash
Test your script by:
%> spark-submit --master spark://<container ip address>:7077 <your other spark paramters>
%> export MASTER=spark://<containerip>:7077
%> run-example SparkPi