In order to start a Spark node as master run the following:
docker run --name spark-master -d -P -e SPARK_NODE_TYPE="master" leoadb/spark
In order to start a Spark node as slave run the following:
docker run --name spark-slave --link spark-master:master -d -P -e SPARK_NODE_TYPE="slave" -e SPARK_MASTER_ADDRESS="spark://master:7077" leoadb/spark
In order to start Scala REPL to communicate to Spark run the following:
docker run --name spark-scala-repl --link spark-master:master -e SPARK_NODE_TYPE="repl" -e SPARK_MASTER_ADDRESS="spark://master:7077" -ti leoadb/spark
Content type
Image
Digest
Size
800.4 MB
Last updated
almost 10 years ago
docker pull leoadb/spark