stondo/docker-spark repository overview

⁠spark

A progrium/busybox based Spark⁠ container. Use it in a standalone cluster with the accompanying docker-compose.yml, or as a base for more complex recipes.

⁠example

To create a standalone cluster with docker-compose⁠:

docker-compose up

The SparkUI will be running at http://${YOUR_DOCKER_HOST}:8080 with one worker listed. To run spark-shell, exec into a container:

docker exec -it dockerspark_master_1 /bin/bash
/usr/spark/bin/spark-shell --master spark://master:7077

⁠license

MIT