youyu/docker-airflow repository overview

⁠Airflow Dockerfile

NOTE: This repository is a fork of puckel/docker-airflow⁠, but uses PostgreSQL and Redis instead of MySQL and RabbitMQ.

Circle CI :

ImageLayers :

This repository contains Dockerfile of airflow⁠ for Docker⁠'s automated build⁠ published to the public Docker Hub Registry⁠.

⁠Informations

• Based on Debian Jessie official Image debian:jessie⁠
• Install Docker⁠
• Install Docker Compose⁠
• Following the Airflow release from Python Package Index⁠

⁠Installation

    docker pull youyu/docker-airflow

⁠Build

For example, if you need to install Extra Packages⁠, edit the Dockerfile and than build-it.

    docker build --rm -t youyu/docker-airflow .

⁠Usage

Start the stack (postgresql, redis, airflow-webserver, airflow-scheduler airflow-flower & airflow-worker) :

    docker-compose up -d

If you want to use Ad hoc query, make sure you've configured connections : Go to Admin -> Connections and Edit "postgresql_default" set this values (equivalent to values in airflow.cfg/docker-compose.yml) :

• Host : postgres
• Schema : airflow
• Login : airflow
• Password : airflow

Check Airflow Documentation⁠

⁠UI Links

• Airflow: localhost:8080⁠
• Flower: localhost:5555⁠
• RabbitMQ: localhost:15672⁠

(with boot2docker, use: open http://$(boot2docker ip):8080)

⁠Run the test "tutorial"

    docker exec dockerairflow_webserver_1 airflow backfill tutorial -s 2015-05-01 -e 2015-06-01

⁠Wanna help?

Fork, improve and PR. ;-)