Sign inSign up

wantoper/hadoop

By wantoper

•Updated over 4 years ago

hadoop-2.7.7 pull mode

Image
0

106

wantoper/hadoop repository overview

⁠如果你后续需要安装spark 建议前往我的仓库 安装 hadoop_spark版本 该版本把spark和hadoop整合在了一起

SSH PASSWD = passwd

⁠生成文件 拷贝出宿主机 后续spark hive需要用到该目录 三台hadoop容器共用一个hadoop目录

docker run -it -d --name master wantoper/hadoop:v1
docker cp master:/usr/local/src/hadoop-2.7.7 /usr/local/src/
docker cp master:/usr/local/src/jdk1.8.0_191 /usr/local/src/
docker stop master
docker rm master

⁠生成网卡 后续spark hive都用该网卡

docker network create hadoop

⁠master

docker run -it -d --name master --hostname master --network hadoop -v /usr/local/src/hadoop-2.7.7:/usr/local/src/hadoop-2.7.7 -v /usr/local/src/jdk1.8.0_191:/usr/local/src/jdk1.8.0_191 -p 50070:50070 -p 8088:8088  wantoper/hadoop:v1

⁠slave1

docker run -it -d --name slave1 --hostname slave1 --network hadoop --volumes-from master wantoper/hadoop:v1

⁠slave2

docker run -it -d --name slave2 --hostname slave2 --network hadoop --volumes-from master  wantoper/hadoop:v1

⁠然后进图每一台机器手动发配ssh密钥

ssh-copy-id master >> yes >>passwd ssh-copy-id slave1 >> yes >>passwd ssh-copy-id slave2 >> yes >>passwd

#在master初始化hadoop 只需初始化一次 不可初始化多次 除非初始化没成功

docker exec -it master hadoop namenode -format

#启动hadoop

docker exec -it master start-all.sh

Tag summary

Content type

Image

Digest

Size

491.4 MB

Last updated

over 4 years ago

docker pull wantoper/hadoop:v1