Sign inSign up

umids/jupyterlab-spark

By umids

•Updated over 6 years ago

All Spark Jupyterlab Docker image from https://github.com/vemonet/jupyterlab-spark

Image
0

1.3K

umids/jupyterlab-spark repository overview

Run Spark Jupyterlab from jupyter/all-spark-notebook⁠.

⁠Pull

docker pull umids/jupyterlab-spark:latest

⁠Run

docker run --rm -it -p 8888:8888 umids/jupyterlab-spark

Notebooks workspace at /home/jovyan in the container.

Share current folder:

docker run --rm -it -p 8888:8888 -v $(pwd):/home/jovyan umids/jupyterlab-spark

Use ${pwd} for Windows current directory.

Define your own password (the sha provided in the example correspond to the password test)

docker run --rm -it -p 8888:8888 umids/jupyterlab-spark start-notebook.sh  --NotebookApp.password='sha1:9316432938f9:93985dffbb854d31308dfe0602a51db947fb7d80'

Generate a hash for your password in a Notebook by running

from notebook.auth import passwd
passwd()

Run as root:

docker run --rm -it -p 8888:8888 -e GRANT_SUDO=yes --user root umids/jupyterlab-spark start-notebook.sh  --NotebookApp.password='sha1:9316432938f9:93985dffbb854d31308dfe0602a51db947fb7d80'

Limit memory and CPU usage:

docker run --rm -it -p 8888:8888 --memory=128g --cpus=24 umids/jupyterlab-spark

⁠Build from source

docker build -t umids/jupyterlab-spark:latest .

Use the requirements.txt file to add packages to be installed at build.

⁠Run as root in Kubernetes

containers:
  - name: jupyter
    image: ${JUPYTER_IMAGE}
    securityContext:
      runAsUser: 0
    env:
    - name: GRANT_SUDO
      value: "yes"
    - name: JUPYTER_ENABLE_LAB
      value: ${JUPYTER_ENABLE_LAB} 
    command:
      - /usr/local/bin/start-notebook.sh
    args:
      - "--NotebookApp.password='${NOTEBOOK_PASSWORD}'"

⁠Installed JupyterLab extensions

⁠Acknowledgments

Alexander Malic for his amalic/Jupyterlab⁠ used as basis for this build.

Tag summary

Content type

Image

Digest

Size

4.7 GB

Last updated

over 6 years ago

docker pull umids/jupyterlab-spark