supermy/ap-hadoop repository overview
Distributed Highly Available Hadoop Cluster Docker Image Based on Alpine
Standalone Mode
Run
docker run -d \
--name=hadoop-standalone \
-p 8088:8088 \
-p 50070:50070 \
-p 14000:14000 \
athlinks/hadoop:2.7 && \
docker logs -f hadoop-standalone
You can view the services here:
HDFS: http://127.0.0.1:50070 YARN: http://127.0.0.1:8088 HTTPFS: http://127.0.0.1:14000Execute Test Job
docker exec -it hadoop-standalone bash -c "bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar teragen 1000 teragen_out_dir"
Clustered Mode
Run
Start the cluster for the first time:
git clone https://github.com/athlinks/docker-hadoop.git
cd docker-hadoop/hadoop-2.7
./initialize.sh
Execute Test Job
docker exec -it hadoop27_client_1 bash -c "bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar teragen 1000 teragen_out_dir"
If you have previously started and stopped the cluster, you can just run "docker-compose up -d" to restart it as the zookeeper format has already been done.
Tag summary
Content type
Image
Digest
Size
261.8 MB
Last updated
about 10 years ago
docker pull supermy/ap-hadoop