laithleo/hadoop repository overview

⁠Apache Hadoop 3.3.1 on top of YARN Docker image!

• Running on top of Ubuntu 20.04
• HDFS commands are included in PATH.
• HDFS and YARN ready to test your Apache Hadoop work!

⁠Build the image

docker build -t laithleo/hadoop:3.3.1 .

⁠Pull the image:

docker pull laithleo/hadoop:3.3.1

⁠Start a container

docker run -p 8088:8088 -it laithleo/hadoop:3.3.1 /tmp/bootstrap.sh -bash

⁠For testing

You can running a MapReduce test job: hadoop jar /opt/hadoop-3.3.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.1.jar grep input output 'dfs[a-z.]+'

And to check the output:

• From your machine host: http://0.0.0.0:8088⁠

OR, from the container itself:

• hdfs dfs -ls /user/root/output/