holsi/spark_base repository overview

⁠Docker Spark Base Image

This repo is intended to be a walkthrough in how to set up a Spark cluster running inside Docker containers. I assume some familiarity with Spark and Docker and their basic commands such as build and run. Everything else will be explained in this file.

Basic image to build the Master, Worker and Submit nodes of a Cluster all with the same TAGS (e.g: 0.0.5)

Spark version: 2.4.2 Scala version: 2.12.8