HUB
Sign inSign up
spark-shell logo

phimar/spark-shell

By phimar

•Updated about 11 years ago

Apache Spark Shell to connect to you own little spark cluster

Image
0

1.7K

phimar/spark-shell repository overview

⁠Run you own little Spark-Cluster!

⁠Start Master:

docker run -d -p 8080:8080 -p 7077:7077 --name master phimar/spark-master

⁠Run and connect slaves:

docker run -d --link master:master phimar/spark-slave

⁠Run interactive shell

docker run -it --rm --link master:master phimar/spark-shell

⁠Using docker-compose:

master:
	image: phimar/spark-master
	ports:
	- "8080:8080"
	- "7077:7077"
slave:
	image: phimar/spark-slave
	links:
	- master:master

⁠Scale slaves:

docker-compose scale slave=5

Tag summary

Content type

Image

Digest

sha256:14aba85e3…

Size

610.9 MB

Last updated

about 11 years ago

docker pull phimar/spark-shell