Sign inSign up

giabar/gb-spark

By giabar

Updated almost 8 years ago

Apache Spark cluster in Docker

Image
0

452

giabar/gb-spark repository overview

Spark Docker images

Docker base image: openjdk:8u181-jdk-stretch (Debian 9.5 with OpenJDK 1.8.181)

Apache Spark version: 2.3.2

Try online

You can try that online! Click the below button:

Try in PWD

Start a Spark cluster:

docker network create spark-net
docker-compose up -d

Launch a Spark application:

docker-compose -f docker-compose-app.yml up -d

How to scale your workers:

docker-compose scale spark-worker=2

Tag summary

Content type

Image

Digest

Size

462.1 MB

Last updated

almost 8 years ago

docker pull giabar/gb-spark:submit