baqend/storm repository overview

⁠docker-storm

We created this image to ease deployment of Apache Storm. More related main.resources:

• Our tutorial on how to use Storm with Docker Swarm⁠
• the baqend/storm on Docker Hub⁠
• the the baqend/storm on GitHub⁠

The Docker image launches Apache Storm. By default, the storm.local.hostname property is set already, but you have to provide all other arguments that you would normally provide.

⁠No need for a storm.yaml!

Storm allows you to provide any property via command line arguments like this:

bin/storm ui \
    -c storm.local.hostname="nimbus"

You are not restricted to strings, but can also provide integer lists:

bin/storm supervisor \
    -c supervisor.slots.ports="[6700,6701]"

Or lists of strings:

bin/storm supervisor \
    -c storm.zookeeper.servers="[\"zk1\",\"zk2\",\"zk3\"]"

You can look up all the parameters in the source code⁠.

⁠Providing ZooKeeper the easy way

This image also lets you specify the ZooKeeper servers with a simple list (e.g. "zk1,zk2,zk3") instead of the more verbose format Storm requires (e.g. "[\"zk1\",\"zk2\",\"zk3\"]"). So if your ZooKeeper cluster is made up of zk1, zk2 and zk3, you can tell Storm to use this cluster by providing the following Docker environment variable:

-e STORM_ZOOKEEPER_SERVERS="zk1,zk2,zk3"

Internally, this is passed to Storm as

-c storm.zookeeper.servers="[\"zk1\",\"zk2\",\"zk3\"]"

⁠Default Values

The baqend/storm Docker image uses the following default values that can be overridden by providing the corresponding arguments in the run statement (e.g. -c nimbus.seeds="[\"nimbus1\",\"nimbus2\"]"):

• -c nimbus.seeds="[\"nimbus\"]": is also overridden by nimbus.host (depreciated since 1.0.0)
• -c storm.local.hostname=<CONTAINER-ID>: by default, the image assigns the value nimbus when nimbus is provided as argument; the docker container ID is used as hostname else
• -c supervisor.slots.ports="[6700,6701,6702,6703]": only when the supervisor argument is provided

In consequence, only the ZooKeeper servers and the role argument (either ui , nimbus or supervisor) have to be provided in a docker run statement.

⁠Further Reading

For an example of how we use this image, also see our tutorial on how to use Storm with Docker Swarm⁠.