Sign inSign up

2breakfast/hadoop

By 2breakfast

•Updated almost 10 years ago

hadoop in docker

Image
0

2.6K

2breakfast/hadoop repository overview

⁠hdfs-datanode

hdfs datanode in docker

⁠How to use it

docker run -e PUBLISHED_IP=X.X.X.X -e HDFS_NAMENODE_RPC_HOST=$NAMENODEHOST -v /data:/var/hdfs/datanode --net=host --name hdfs-dn -d 2breakfast/hadoop:centos7-2.7.3-dn

⁠Exposed ports

  • TCP 50010 dfs.datanode.address port for data transfer
  • TCP 50020 dfs.datanode.ipc.address ipc server
  • TCP 50075 dfs.datanode.http.address http server
  • TCP 50475 dfs.datanode.https.address https server

⁠FAQ

Q1: Tab Overview is giving me 3 living datanodes on namenode webpage, while tab Datanodes is showing 1 living datanode only.Why?

A1. Plz make sure your datanode servers have the different hostname

Tag summary

Content type

Image

Digest

Size

465 MB

Last updated

almost 10 years ago

docker pull 2breakfast/hadoop:centos7-2.7.3-dn