Public Repository

Last pushed: 5 months ago
Short Description
Just a SparkCluster docker image
Full Description

Tags image flavours:

#v210

  ____              __
 / __/__  ___ _____/ /__
_\ \/ _ \/ _ `/ __/  '_/

/_/ ./_,// //\\ version 2.1.0
/_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_131)

  • HADOOP_VERSION 2.8.0

#v211

  ____              __
 / __/__  ___ _____/ /__
_\ \/ _ \/ _ `/ __/  '_/

/_/ ./_,// //\\ version 2.1.1
/_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_131)

  • HADOOP_VERSION 2.7.3

#1 get the image:

docker pull xval/sparkss:v21X

#2 Launch the cluster of docker containers (it needs docker-compose.yml):

docker-compose up

#3 Run your spark-shell with just:

docker exec -it spark21X_master_1 /bin/bash spark-shell

Docker Pull Command
Owner
xval