Public Repository

Last pushed: 3 years ago
Short Description
Hadoop 2.6 with hive + hive-enabled spark
Full Description

Builds on cdecl/hadoop-live with a single node spark cluster built with hive and yarn support.

This instance of spark is configured to bind to the eth0 ipv4 ip address.

Run with the below command to give you a bash session on a server running a spark cluster.

docker run -it --rm -p 8080:8080 -p 7077:7077 gsoertsz/hadoop-hive-spark -bash

Test your script by:
%> spark-submit --master spark://<container ip address>:7077 <your other spark paramters>
%> export MASTER=spark://<containerip>:7077
%> run-example SparkPi

Docker Pull Command