workerlist-gen is a simple Docker image intended to run on a container colocated with a Citus master node container. It uses
docker-gen to automatically regenerate the Citus worker list file any time a Citus container is destroyed or added.
workerlist-gen wraps a single
docker-gen process, which responds to Docker events by regenerating a worker list file. This file will contain the hostnames of all containers with a
com.citusdata.role label value of
Worker. All workers are assumed to be running a Citus instance on port
The worker list file will be written to
/etc/citus/pg_worker_list.conf any time the set of worker nodes changes. After updating the file,
docker-gen will call
psql) against a container named
citus_master, forcing the Citus instance to repopulate its worker list table.
psql expects to connect over a socket.
Assuming your Docker daemon’s socket is located at
/var/run/docker.sock (the default), you can start a
workerlist-gen container like so:
docker run --name workerlist-gen \ -v /var/run/docker.sock:/tmp/docker.sock \ citusdata/workerlist-gen
docker-gen expects the Docker daemon’s socket to exist at
/tmp/docker.sock, so the
-v flag is needed to ensure it is mounted at that location, though the
DOCKER_HOST environment variable can be used to override that expectation. The
docker-gen project page providers further details.
workerlist-gen honors a few environment variables in addition to those permitted by
CITUS_CONFDIR— Output directory for worker list file (default:
Let’s say a Citus container named
citus_master is already running. The person who started it had the foresight to expose its configuration files as a
/etc/citusconf. That location is non-standard, but nothing
workerlist-gen can’t handle:
docker run --name workerlist-gen \ -v /var/run/docker.sock:/tmp/docker.sock \ --volumes-from citus_master \ -e CITUS_CONFDIR=/etc/citusconf \ citusdata/workerlist-gen
volumes-from option ensures the
/etc/citusconf path is shared between the
citus_master container, so the configuration is available for reading by the master after
workerlist-gen sends the
Copyright © 2016 Citus Data, Inc.
Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.