Public | Automated Build

Last pushed: 5 months ago
Short Description
Spark worker image for use with Zoe, the Analytics as a Service system.
Full Description

Spark worker image

This image contains the Scala worker process. It is used by Zoe, the Container Analytics as a
Service system to create on-demand Spark clusters in standalone mode.

Zoe can be found at: https://github.com/DistributedSystemsGroup/zoe

Setup

The Dockerfile runs the worker process when run. The following options can be passed via environment variables:

  • SPARK_MASTER_IP: IP address of the Spark master this notebook should use for its kernel
  • SPARK_WORKER_RAM: How much RAM the worker can use (default is 4g)
  • SPARK_WORKER_CORES: How many cores can be used by the worker process (default is 4)
Docker Pull Command
Owner
zoeapps

Comments (0)