The spark docker image dockerfile
docker run -d --name hadoop-namenode -p 9000:9000 -p 50070:50070 -p 18088:8088 -p 19888:19888 -e NAMENODE=true vikings/spark
docker run -d --name hadoop-datanode1 -p 51070:50070 -p 28088:8088 -p 29888:19888 --link hadoop-namenode:namenode -e DATANODE=true vikings/spark
Notice:
Slave must use:
--link hadoop-namenode:namenode -e DATANODE=true
Currently, master and slave must exist in the same host!!
Content type
Image
Digest
Size
1 GB
Last updated
over 9 years ago
docker pull vikings/spark