Sign inSign up

xval/sparkss

By xval

•Updated over 9 years ago

Just a SparkCluster docker image

Image
0

206

xval/sparkss repository overview

Tags image flavours:

#v210 ____ __ / / ___ / / \ / _ / _ `/ __/ '/ // .__/_,// //_\ version 2.1.0 //

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_131)

  • HADOOP_VERSION 2.8.0

#v211 ____ __ / / ___ / / \ / _ / _ `/ __/ '/ // .__/_,// //_\ version 2.1.1 //

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_131)

  • HADOOP_VERSION 2.7.3

#1 get the image:

docker pull xval/sparkss:v21X

#2 Launch the cluster of docker containers (it needs docker-compose.yml):

docker-compose up

#3 Run your spark-shell with just:

docker exec -it spark21X_master_1 /bin/bash spark-shell

Tag summary

Content type

Image

Digest

Size

451.2 MB

Last updated

over 9 years ago

docker pull xval/sparkss:v2118