Spark Docker image to use in Rancher
# starting spark master: docker run qulo/rancher-spark master <hostname or ip of the master> # starting spark worker: docker run qulo/rancher-spark worker <hostname or ip of the master>
Running with docker-compose
# starting docker-compose up # skaling workers to 3 docker-compose scale spark-worker=3 # stopping docker-compose stop
Running in Rancher
WARNING: this will open port 8080 on the spark-master to public
create a service stack and use docker-compose.yml service creation.
Docker Pull Command