jforge/datascience repository overview

⁠Docker image for mostly Python-based data science tools

This repository is created to work with data science tools in context of respective courses on the web.

Starts a jupyter notebook instance by default for convenience.

Focuses on providing the essentials, but adds paho-mqtt a MQTT client library. This is for interaction with environments for IIoT use cases.

This Docker images comes with:

• NumPy
• Pandas
• Matplotlib
• Seaborn
• Jupyter
• paho-mqtt

Candidates for next integration steps:

• Sklearn
• pyyaml
• h5py
• Tensorflow
• Keras
• OpenCV 3

The images are built on top of Ubuntu 20.04 Docker container⁠ (Dockerfile⁠)

⁠Examples

The notebooks⁠ folder contains sample notebooks to demonstrate mqtt publish and subscribe together with a real-time graph.

⁠Usage

Run a Docker container from this image using the following command:

docker run -it -p 8888:8888 -d \
  -v $(pwd)/notebooks:/notebooks \
  jforge/datascience:latest

Exposing port 8888 and mapping the notebooks folder supports the work with the Jupyter UI.

Example docker composition (makes use of the baseurl parameter for the start-jupyter script):

services:
  jupyter:
    image: jforge/datascience:latest
    ports:
      - "8888:8888/tcp"
    restart: unless-stopped
    volumes:
      - jupyter-notebooks:/notebooks
    command:
      - '--NotebookApp.base_url=/ipython'

volumes:
  jupyter-notebooks:

⁠Jupyter configuration

Fixed defaults are stored in the conf/.jupyter folder containing a jupyter notebook configuration⁠ and a customization for notebook⁠.

⁠Contained tools & libraries

The following tools and libraries are integration to work in the field of data science and scientific computing.

⁠Numpy

NumPy⁠ is a library for the Python programming language, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions to operate on these arrays.

⁠Pandas

Pandas⁠ is a fast, powerful, flexible and easy to use open source data analysis and manipulation tool, built on top of the Python programming language.

⁠Matplotlib

Matplotlib⁠ Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations in Python.

⁠Seaborn

Seaborn⁠ is a library for making statistical graphics in Python. It is built on top of matplotlib and closely integrated with pandas data structures.

⁠Jupyter

Project Jupyter⁠ exists to develop open-source software, open-standards, and services for interactive computing across dozens of programming languages.

The Jupyter Notebook is an open-source web application to create and share documents that contain live code, equations, visualizations and narrative text. Among others, uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning.

⁠Paho-MQTT

paho-mqtt⁠ is the Eclipse Paho MQTT Python client library, which implements versions 5.0, 3.1.1, and 3.1 of the MQTT protocol.