Sign inSign up

bletvaska/airflow

By bletvaska

Updated almost 4 years ago

Apache Airflow mini Docker image mainly for my Apache Airflow 101 course, but also for dev purposes.

Image
0

403

bletvaska/airflow repository overview

Apache Airflow Mini

This is my mini Docker image for my Apache Airflow course. It is created only from basic installation and configuration and by default it is running as standalone.

Tags

Running the Airflow

Recommended way of running the image:

$ docker container run --rm \
  --name airflow \
  --publish 8080:8080 \
  --volume /path/to/your/airflow/home/folder:/airflow \
  bletvaska/airflow

If you need additional packages

Create the file requirements.txt in your airflow directory. When you will be running the container, the packages from this file will be installed automatically.

Environment Variables

This image uses several environment variables:

  • AIRFLOW_USER_ID - The ID of the user the Airflow will run. This is useful to set the ID of your local user just to avoid the issues with the files, which will Airflow create. Default value is set to 1000.
  • AIRFLOW_USER - The username to access the Web UI. Default value is set to admin.
  • AIRFLOW_PASSWORD - The password to access the WEB UI. Default value is set to admin.

And you can still use all of the environment variables related to Airflow and it's configuration. So if you for example want to hide all of the example DAGs, you can export AIRFLOW__CORE__LOAD_EXAMPLES environment variable.

Putting it all together, you can create environment file:

# airflow.env

AIRFLOW_USER_ID=1001
AIRFLOW_USER=batman
AIRFLOW_PASSWORD=gotham
AIRFLOW__CORE__LOAD_EXAMPLES=False
AIRFLOW__WEBSERVER__DEFAULT_UI_TIMEZONE=Europe/Bratislava

And run it:

$ docker container run --rm \
  --publish 8080:8080 \
  --volume /path/to/your/airflow/home/folder:/airflow \
  --name airflow \
  --env-file airflow.env \
  bletvaska/airflow

Tag summary

Content type

Image

Digest

sha256:d2630e7e8

Size

102.2 MB

Last updated

almost 4 years ago

docker pull bletvaska/airflow