kentore82/centos_python_spark_hdfs repository overview

⁠Github

https://github.com/kentore82/dockerfiles/tree/master/centos_python_spark_hdfs⁠

⁠Deploy

docker run -d --cap-add SYS_ADMIN --security-opt seccomp:unconfined -v centos_dev:/tmp/python_dev --privileged -h pythondev --name centos_python_spark_hdfs --dns=8.8.8.8 --add-host <host_to_add>:<ip_to_add> -p 22:22 -p 9999:8888 --restart always kentore82/centos_python_spark_hdfs:7.8_3.6.8_2.4.7_3.2.1

⁠Versions

The image tag reflects the version of centos, python, spark and hdfs respectively.

⁠Howto

• hdfs runs as service hdfs

• jupyter runs as service jupyter

• ssh is exposed on port 22

• jupyter is exposed on port 9999

• ssh to container root/root: ssh root@localhost

• get jupyter token ´systemctl status jupyter'

• jupyter url: http://127.0.0.1:9999/?token=⁠