Public Repository

Last pushed: 2 months ago
Short Description
Mist is a thin service on top of Spark which makes it possible to execute Jobs from application
Full Description


Hydrosphere Mist is a service for exposing analytical jobs and machine learning models as web services.

Mist provides an API for Scala & Python Apache Spark jobs and for machine learning models trained in Apache Spark.

It implements Spark as a Service and creates a unified API layer for building enterprise solutions and services on top of a big data stack.

Supported tags and respective Dockerfile links

Currently, build from master branch (Dockerfile)
Spark version for tags:

  • 1.5.2
  • 1.6.2
  • 2.0.0
  • 2.1.0

Using this Image

Running Mist

docker run -p 2003:2003 -v /var/run/docker.sock:/var/run/docker.sock -d hydrosphere/mist:master-$SPARK_VERSION mist


Modify default configuration and copy it to $PWD. Then start the Mist container:

docker run -d -p 2003:2003 -v $PWD/docker.conf:/usr/share/mist/configs/docker.conf hydrosphere/mist:master-$SPARK_VERSION mist

Build image from source

docker build --build-arg SPARK_VERSION=$SPARK_VERSION -t hydrosphere/mist:latest .
Docker Pull Command