pslq/mldl-ppc64le repository overview

At version 1.0.0, I have adopted more consistent organization of the data within the container all custom compiled packages are stored into /opt/oss-mldl

Now the container is being built on top of nvidia/ppc64le image, which allow better integration with nvidia-docker1

Custom deb packages installed: oot@04ef68dd807f:/opt/oss-mldl# dpkg -l | grep -i pslq | awk '{ print $2,$3; }' bazel-pslq 0.9.0 cython-pslq 0.2.7 fftw-pslq 3.3.7 hdf5-pslq 1.10.1 magma-pslq 2.3.0 matplotlib-pslq 2.1.2 nccl-pslq 1git numpy-pslq 1.14.0 openblas-pslq 0.2.20 opencv-pslq 3.4.0 openmpi-pslq 3.0.0 pandas-pslq 0.22.0 pillow-pslq 1git.02042018 pip-pslq 9.0.1 protobuf-pslq 3.5.1 python3-pslq 3.6.4 scipy-pslq 1.0.0 root@04ef68dd807f:/opt/oss-mldl#

---

Custom pip packages installed:

root@04ef68dd807f:/opt/oss-mldl# pip list absl-py (0.1.10) asn1crypto (0.24.0) attrs (17.4.0) Automat (0.6.0) beautifulsoup4 (4.6.0) bleach (1.5.0) blinker (1.4) bs4 (0.0.1) certifi (2018.1.18) cffi (1.11.4) chardet (3.0.4) confu (0.0.3) constantly (15.1.0) coverage (4.5) cryptography (2.1.4) cymem (1.31.2) Cython (0.27.3) cytoolz (0.8.2) decorator (4.2.1) dill (0.2.7.1) docopt (0.6.2) elasticsearch-tornado (2.0.9) entrypoints (0.2.3) fastrlock (0.3) ftfy (4.4.3) future (0.16.0) gi (1.2) greenlet (0.4.13) h5py (2.7.1) hdfs (2.1.0) html5lib (0.9999999) hyperas (0.4) hyperlink (17.3.1) hyperopt (0.1) idna (2.6) incremental (17.5.0) ipaddress (1.0.19) ipykernel (4.8.1) ipython (6.2.1) ipython-genutils (0.2.0) ipywidgets (7.1.1) itsdangerous (0.24) JayDeBeApi (1.1.1) jedi (0.11.1) Jinja2 (2.10) JPype1 (0.6.2) jsonschema (2.6.0) jupyter (1.0.0) jupyter-c-kernel (1.2.2) jupyter-client (5.2.2) jupyter-console (5.2.0) jupyter-core (4.4.0) jupyter-dashboards (0.7.0) jupyter-pip (0.3.1) jupyter-slack (1.0.1) jupyter-tensorboard (0.1.5) jupyter-themer (0.4.0) jupyter-wysiwyg (0.1.3) jupyterlab-github (0.5.0) kazoo (2.4.0) Keras (2.1.3) keras-gradient-noise (0.1) keras-rl (0.4.0) keras-utilities (0.2.1) kerasplugins (0.1.5) lmdb (0.93) lxml (4.1.1) Markdown (2.6.11) MarkupSafe (1.0) matplotlib (2.1.2) mistune (0.8.3) monk (0.13.2) msgpack-numpy (0.4.1) msgpack-python (0.5.4) murmurhash (0.28.0) nbconvert (5.3.1) nbformat (4.4.0) networkx (2.1) nltk (3.2.5) nose (1.3.7) notebook (5.4.0) numexpr (2.6.4) numpy (1.14.0) olefile (0.45.1) pandas (0.22.0) pandocfilters (1.4.2) parso (0.1.1) pathlib (1.0.1) pexpect (4.3.1) PGen (0.2.1) pgen2 (0.1.0) pgsql (1.1) pickleshare (0.7.4) Pillow (5.1.0.dev0) pip (9.0.1) plac (0.9.6) pluggy (0.6.0) preshed (1.0.0) prompt-toolkit (1.0.15) protobuf (3.5.1) ptyprocess (0.5.2) py4j (0.10.4) pycparser (2.18) pycrypto (2.6.1) pycurl (7.43.0.1) pydicom (0.9.9) PyDispatcher (2.0.5) pydot (1.2.4) Pygments (2.2.0) pyinotify (0.9.6) pymongo (3.6.0) pyparsing (2.2.0) pyspark (2.2.1) pyspark-db-utils (0.0.1) python-dateutil (2.6.1) PyWavelets (0.5.2) PyYAML (3.12) pyzmq (16.0.4) qtconsole (4.3.1) redis (2.10.6) regex (2017.4.5) requests (2.18.4) requests-futures (0.9.7) retrying (1.3.3) scikit-image (0.13.1) scikit-learn (0.19.1) scipy (1.0.0) Send2Trash (1.4.2) setuptools (38.5.1) simplegeneric (0.8.1) simplejson (3.13.2) six (1.11.0) sklearn (0.0) slacker (0.9.60) slimurl (0.7.8) telegram (0.0.1) tensorflow (1.5.0) tensorflow-tensorboard (1.5.1) termcolor (1.1.0) terminado (0.8.1) testpath (0.3.1) thinc (6.10.2) toolz (0.9.0) torch (0.4.0a0+2bf9ed8) tornado (4.5.3) tornado-redis (2.4.18) tornado-rest (1.0) tornado-tools (0.3.0) tornado-utils (1.6) tornado-websocket-server (0.1.5a1) tqdm (4.19.5) traitlets (4.3.2) Twisted (17.9.0) ujson (1.35) urllib3 (1.22) wcwidth (0.1.7) webencodings (0.5.1) Werkzeug (0.14.1) wheel (0.30.0) widgetsnbextension (3.1.3) wrapt (1.10.11) zope.interface (4.4.3) root@04ef68dd807f:/opt/oss-mldl#

Spark 2.2.1 has been installed at /opt/spak

RDMA support have been included, and version used as basis is MLNX_OFED_LINUX-4.2-1.2.0.0 To run with RDMA support, please follow instructions at: https://community.mellanox.com/docs/DOC-3014⁠ https://community.mellanox.com/docs/DOC-2971⁠

Binary packages used for this install are stored at: /opt/extra For Compilation instructions: https://github.com/pslq/tools⁠ In order to keep the image small, development packages have been removed, a full list of installed packages before clean up can be found at /opt/extra/pkg_list_before_remove

THIS IMAGE HAS BEEN CREATED FOR EDUCATION PURPOSES ONLY - NO SUPPORT IS OR WILL BE PROVIDED FOR IT