Three node Hadoop cluster for the Apcera Platform
975
Run a three node Hadoop cluster on the Apcera Platform. Feel free to test this out on the Apcera Platform Community Edition https://www.apcera.com/community-edition.
Hadoop 2.7.2
Pig 0.16.0
OpenJDK 8
apc network create hadoop --batch
apc docker create hadoop1 -i apcerademos/hadoop -m 3g --port 50070 --port 8088 --port 22 -ae -e CONFIG=MASTER -e HADOOP_HOSTNAME="hadoop1.apcera.local"
apc docker create hadoop2 -i apcerademos/hadoop -m 3g -e HADOOP_HOSTNAME="hadoop2.apcera.local"
apc docker create hadoop3 -i apcerademos/hadoop -m 3g -e HADOOP_HOSTNAME="hadoop3.apcera.local"
apc network join hadoop -j hadoop1 -da hadoop1
apc network join hadoop -j hadoop2 -da hadoop2
apc network join hadoop -j hadoop3 -da hadoop3
Do not change the -da name because the configuration files are hard coded
apc app start hadoop1
apc app start hadoop2
apc app start hadoop3
If you are running Apcera Community Edition, you can get the IP with "./apcera-setup status". You can change port 9999 to a port that you want to connect to the cluster externally.
apc route add central_ip:9999 --app hadoop1 --tcp --port 22 --batch
apc route add http://dfs.my-cluster.apcera-platform.io --app hadoop1 --port 50070 --batch
apc route add http://yarn.my-cluster.apcera-platform.io --app hadoop1 --port 8088 --batch
Username: root
Password: training
ssh root@central_ip -p 9999
bash /tests.sh
The test script copies a Debian package installation log to the Hadoop File System and searches for instances of the word "Java".
Content type
Image
Digest
Size
905 MB
Last updated
about 10 years ago
docker pull apcerademos/hadoop