Public | Automated Build

Last pushed: 2 years ago
Short Description
Short description is empty for this repo.
Full Description

Basic Hadoop image

Overview

Installs Hadoop and it's dependencies.
Can run a number of hadoop client commands outlined below. Serves as a baseline to all the other hadoop/cassandra related images under the andlaz repo -- hadoop-cassandra, hadoop-hdfs-namenode, hadoop-yarn-resourcemanager

Usage

There is nothing in this image to help you configure or start any of the Hadoop deamons. Those you will find in

  • andlaz/hadoop-cassandra ( data node, node manager )
  • andlaz/hadoop-hdfs-namenode ( name node )
  • andlaz/hadoop-yarn-resourcemanager ( resource manager )

Nevertheless, you can ( and should ) use this image to run hdfs/yarn/mapred client commands.

Install Locations
  • /opt/hadoop-2.7.0
  • /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.45-30.b13.el7_1.x86_64/

JAVA_HOME is set and the hadoop bin folder added to PATH

Client command example

n.b. in the example below resourcemanager is the host of the resource manager

docker run \
    -e "YARN_CLIENT_OPTS=-Dyarn.resourcemanager.hostname=resourcemanager" \
    -ti --rm \
    andlaz/hadoop-base \
    yarn node -list
Docker Pull Command
Owner
andlaz
Source Repository