Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows.
Azkaban consists of 3 key components:
- Relational Database (MySQL)
Base Docker Image
- Official java:8
Alternatively, you can build an image from Dockerfile.
docker-compose up -d docker-compose ps
The repository contains a shell script to test the azkaban stack: testing/test_api.sh (require jq).