ppatcoding/airflow repository overview

⁠Customized airflow docker

⁠Dependencies

• airflow==1.10.14
• hadoop==3.2.1
• hive==3.1.2
• spark==3.1.1
• sqoop==1.4.7

⁠How to run

You can clone this repository and run the following command to start the airflow webserver.

docker compose up -d

You can access the airflow webserver with http://localhost:8080⁠

It's already mount the dags and plugins parts to the docker volume, please feel free to change the configuration in the docker-compose.yml for you preference.

To close the airflow container

docker compose down -v

⁠References

• Airflow docker based : https://github.com/puckel/docker-airflow⁠
• Hadoop based configuration : https://github.com/pavank/docker-bigdata-cluster⁠