Sign inSign up

nikush001/hadoop

By nikush001

•Updated over 5 years ago

Image
0

359

nikush001/hadoop repository overview

##Environment Variables

| Env                 | Cluster | default                                               | options                                                                                                                                  |
|---------------------|---------|-------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------|
| MODE                | Y       | standalone                                            | standalone /  cluster                                                                                                                    |
| NAMENODE_FORMAT     | Y       | false                                                 | [true\|false]                                                                                                                            |
| MASTER_NODE         | Y       |                                                       | [Name of the master node i.e. master-node](cluster)                                                                                      |
| MASTER_NODE_HOST_IP | Y       |                                                       | [Name of the master node ip i.e. master-node](cluster)                                                                                   |
| WORKERS             | Y       |                                                       | [define all the nodes of the cluster i.e. worker-1,worker-2]                                                                             |
| INSTALL_HIVE        |         | false                                                 | false / true                                                                                                                             |
| HIVE_INIT           |         | false                                                 | [true\|false]                                                                                                                            |
| HIVE_MS_DB_TYPE     |         | derby                                                 | [derby\|mysql\|postgres\|oracle\|mssql]                                                                                                  |
| HIVE_MS_DRIVER      |         | org.apache.derby.jdbc.ClientDriver                    | org.apache.derby.jdbc.ClientDriver org.postgresql.Driver                                                                                 |
| HIVE_CONN_URL       |         | jdbc:derby://localhost:1527/metastore_db; create=true | jdbc:derby://localhost:1527/metastore_db;create=true  jdbc:postgresql://postgres-metastore:5432/metastore ?createDatabaseIfNotExist=true |
| HIVE_CONN_USER      |         |                                                       |                                                                                                                                          |
| HIVE_CONN_PASS      |         |                                                       |                                                                                                                                          |

##To run standalone single node hadoop custer build the image if you have docker file - docker build -t hadoop .

run the dockrer image -

docker run --name hadoop -e NAMENODE_FORMAT=Y hadoop
docker run --name hadoop -e NAMENODE_FORMAT=Y -e INSTALL_HIVE=Y -e HIVE_INIT=Y -p 10000:10000 -p 9083:9083 -p 10002:10002 hadoop

Tag summary

Content type

Image

Digest

Size

786.5 MB

Last updated

over 5 years ago

docker pull nikush001/hadoop:2.7.4