I have java sources that create and resize cluseter automatically using java remote api, but I don't know how to upload. If you want to build cluster yourself, follow this guide line.
<1>. Create master and slaves using run command. e.g :
-> docker run -i -t –name master -h master -p 50070:50070 alicek106/hadoop:0.5 /bin/bash
(50070 port is NameNode dashboard. If you want to use webhcat or other dependencies, add more -p option)
-> docker run -i -t –name slave0 -h slave0 –link master:master alicek106/hadoop:0.5 /bin/bash
…… and just slave containers as you like!
<2>. Confirm slaves' virtual IP. If slave0's ip is 172.17.0.5, slave1's ip will be 172.17.0.6
<3>. Attach to master and edit /etc/hosts. Add lines like below
….. if you have more slaves, just add lines!
<4>. Edit $HADOOP_CONFIG_HOME/slaves like below :
….. more slaves?
<5>. Start all components
<6>. Check whether all slaves are working.
-> hdfs dfsadmin -report
If you have any problems, contact me as firstname.lastname@example.org or blog.naver.com/alice_k106