Sign inSign up

csit6000o/quickstart

By csit6000o

•Updated over 4 years ago

Cloudera QuickStart for HKUST CSIT6000O

Image
0

2.5K

csit6000o/quickstart repository overview

The following describes the specific steps for using the quickstart image.

  1. Pull the image
$ docker pull csit6000o/quickstart:latest
  1. Launch the container

Before you run the command, you should replace $LOCAL_DIR with your local directory, which allows you to edit code locally and run commands in the docker container.

$ docker run --hostname=quickstart.cloudera --privileged=true -d -it \
-p 2181:2181 \
-p 7077:7077 \
-p 7180:7180 \
-p 8020:8020 \
-p 8022:8022 \
-p 8042:8042 \
-p 8080:8080 \
-p 8088:8088 \
-p 8888:8888 \
-p 8983:8983 \
-p 9090:9090 \
-p 11000:11000 \
-p 16000:16000 \
-p 19888:19888 \
-p 50030:50030 \
-p 50070:50070 \
-p 50075:50075 \
-p 60010:60010 \
-p 60030:60030 \
-v $LOCAL_DIR:/host \
--memory 8g \
--name cloudera_quickstart \
csit6000o/quickstart:latest \
/etc/bootstrap.sh -bash
  1. Login to the container
$ docker exec -it cloudera_quickstart bash
  1. Activate the environment
$ source /etc/environment
  1. The correspondence between ports and services is as follows:
 Port Service
 2181 Zookeeper
 7077 Spark Master
 7180 Cloudera Manager
 8020 HDFS
 8022 SSH
 8042 YARN Node Manager
 8080 HBase Rest
 8088 YARN Resource Manager
 8888 Hue
 8983 Solr
 9090 HBase Thrift
11000 Oozie
16000 Sqoop Metastore
19888 MapReduce Job History
50030 MapReduce Job Tracker
50070 HDFS Rest Namenode
50075 HDFS Rest Datanode
60010 HBase Master
60030 HBase Region

For example, you can visit the webpage of Hadoop, view the status of nodes and submitted jobs via localhost:8088.

  1. Stop & remove the container
$ docker stop cloudera_quickstart && docker rm cloudera_quickstart

Tag summary

Content type

Image

Digest

Size

812.3 MB

Last updated

over 4 years ago

docker pull csit6000o/quickstart