duyetdev/spark repository overview

This repository contains a Docker file to build a Docker image with Apache Spark.

⁠Pull the image from Docker Repository

docker pull duyetdev/spark

⁠Building the image

docker build --rm -t duyetdev/spark .

⁠Running the image

If using boot2docker make sure your VM has more than 2GB memory in your /etc/hosts file add $(boot2docker ip) as host 'sandbox' to make it easier to access your sandbox UI open yarn UI ports when running container

docker run -it -p 8088:8088 -p 8042:8042 -h sandbox duyetdev/spark bash

or

docker run -d -h sandbox duyetdev/spark -