agirish/zookeeper repository overview

⁠Apache Drill on Docker

⁠Embedded mode

To quickly try out Apache Drill on a single node, install Drill in embedded mode. When launching Drill in embedded mode via the Drill shell, a local Drillbit service starts automatically. Drillbits are also automatically stopped when exiting from the shell.

Below are steps to launch a single Drillbit in a Docker environment. It assumes that the Docker service is up and running on the host.

⁠Launch Drill container

git clone [email protected]:agirish/drill-containers.git
cd drill-containers/docker/centos/drill
./launch.sh 1.13.0 

⁠Start Drillbits

/opt/drill/bin/drill-embedded

⁠Distributed mode

Drill can be deployed in a distributed cluster environment, for large-scale data processing. Zookeeper is used for cluster co-ordination and is a pre-requisite for this mode. The current set of images include stand-alone zookeeper and drill. HDFS is not included.

⁠Launch Zookeeper container

git clone [email protected]:agirish/drill-containers.git
cd drill-containers/docker/centos/zookeeper
./launch.sh

Make a note of the ZK container IP address (ZK_IP_ADDR)

⁠Launch Drill container

git clone [email protected]:agirish/drill-containers.git
cd drill-containers/docker/centos/drill
./launch.sh 1.13.0 

⁠Configure Drillbits

Edit /opt/drill/conf/drill-override.conf. Update the zk.connect string with the ZK container IP address

⁠Start Drillbits

/opt/drill/bin/drillbit.sh start
/opt/drill/bin/sqlline -u jdbc:drill:zk=ZK_IP_ADDR:2181

⁠Building Custom Docker Images

The docker⁠ directory contains Dockerfiles & dependencies required to build and customize Docker images. Included are docker for Apache Drill and Apache ZooKeeper.

The project directory contains scripts needed to build, push and launch Docker containers

⁠Build ZooKeeper⁠

Takes in no parameters. Example below:

cd drill-containers/docker/centos/zookeeper
./build.sh

⁠Build Drill⁠

Takes in 1 parameters - the project version. Example below:

cd drill-containers/docker/centos/drill
./build.sh 1.14.0

⁠Launch ZooKeeper⁠

Takes in no parameters. Example below:

cd drill-containers/docker/centos/zookeeper
./launch.sh

⁠Launch Drill⁠

Takes in 1 parameters - the project version. Example below:

cd drill-containers/docker/centos/drill
./launch.sh 1.14.0