Public Repository

Last pushed: a year ago
Short Description
Just a SparkCluster docker image
Full Description

Tags image flavours:

#v210
__
/ / _ ___/ /
_\ \/ _ \/ _ `/
/ '_/
/_/ ./_,_// //_\ version 2.1.0
/_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_131)

  • HADOOP_VERSION 2.8.0

#v211
__
/ / _ ___/ /
_\ \/ _ \/ _ `/
/ '_/
/_/ ./_,_// //_\ version 2.1.1
/_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_131)

  • HADOOP_VERSION 2.7.3

#1 get the image:

docker pull xval/sparkss:v21X

#2 Launch the cluster of docker containers (it needs docker-compose.yml):

docker-compose up

#3 Run your spark-shell with just:

docker exec -it spark21X_master_1 /bin/bash spark-shell

Docker Pull Command
Owner
xval