Sign inSign up

leoadb/spark

By leoadb

Updated almost 10 years ago

JDK 1.8 + Scala 2.11.8 + Spark 2.0.2

Image
0

224

leoadb/spark repository overview

In order to start a Spark node as master run the following:

docker run --name spark-master -d -P -e SPARK_NODE_TYPE="master" leoadb/spark

In order to start a Spark node as slave run the following:

docker run --name spark-slave --link spark-master:master -d -P -e SPARK_NODE_TYPE="slave" -e SPARK_MASTER_ADDRESS="spark://master:7077" leoadb/spark

In order to start Scala REPL to communicate to Spark run the following:

docker run --name spark-scala-repl --link spark-master:master -e SPARK_NODE_TYPE="repl" -e SPARK_MASTER_ADDRESS="spark://master:7077" -ti leoadb/spark

Tag summary

Content type

Image

Digest

Size

800.4 MB

Last updated

almost 10 years ago

docker pull leoadb/spark