Public Repository

Last pushed: 2 years ago
Short Description
Derived from Clay Tantor's container "docker-centos-cloudera-5-3-1"
Full Description

Credit: Clay Tantor

Run docker in CentOS host.

Requirements

  • 4 GB memory

Map these directories to host

| Directory                        | Use             |
| -------------------------------- | --------------- | 
| /var/cm/datanode1                | Datanode1       | 
| /var/cm/datanode2                | Datanode2       |
| /var/cm/datanode3                | Datanode3       |
| /var/cm/nn                       | Name Node       |
| /var/cm/snn                      | Secondary Node  |
| /var/cm/nm                       | NM dir          |
| /var/cm/impala                   | Impala          |
| /var/cm/hive                     | Hive data       |
| /var/cm/cloudera-host-monitor    | Host monitor    |
| /var/cm/cloudera-service-monitor | Service monitor |
| /var/cm/sqoop2                   | Sqoop2 data     |
| /var/cm/zookeeper                | Zookeeper data  |
sudo docker run --privileged=true -m=4g -i -p 49122:22 -p 2181:2181 -p 7180:7180   -p 7182:7182 -p 50010:50010 -p 50075:50075 -p 50020:50020 -p 8020:8020   -p 50070:50070 -p 50090:50090 -p 8032:8032 -p 8030:8030 -p 8031:8031   -p 8033:8033 -p 8088:8088 -p 8040:8040 -p 8042:8042 -p 8041:8041   -p 10020:10020 -p 19888:19888 -p 41370:41370 -p 38319:38319   -p 10000:10000 -p 21050:21050 -p 25000:25000 -p 25010:25010   -p 25020:25020 -p 18080:18080 -p 7077:7077 -p 7078:7078 -p 9000:9000   -p 9001:9001 -p 8888:8888 -t qurius/docker-centos6-cloudera-5:v1 /bin/bash

Test

sudo -l hdfs -s
hadoop fs -mkdir -p /user/joe
hadoop fs -chown joe /user/joe
hadoop fs -mkdir input
hadoop fs -put /etc/hadoop/conf/*.xml input
hadoop jar /usr/lib/hadoop-mapreduce/hadoop-examples.jar grep input output 'dfs[a-z.]+'
Docker Pull Command
Owner
qurius