Sign inSign up

stiborv/etl-webserver

By stiborv

•Updated about 2 years ago

Extract transform load (ETL) service's Airflow webserver.

Image
0

289

stiborv/etl-webserver repository overview

⁠etl-webserver

docker pull stiborv/etl-webserver:latest
  • The third part of the whole ETL service.
  • All parts of ELT are needed - example of compose with custom network:
services:
  postgres:
    image: stiborv/etl-postgres:latest
    ...

  scheduler:
    image: stiborv/etl-scheduler:latest
    ...

  webserver:
    image: stiborv/etl-webserver:latest
    container_name: etl_webserver
    ports:
      - "${HOST_MACHINE_AIRFLOW_SERVER_PORT}:${CONTAINER_AIRFLOW_SERVER_PORT}"
    command: >
      bash -c "
      airflow db migrate &&
      airflow webserver -p 8080"
    restart: on-failure
    depends_on:
      postgres:
        condition: service_healthy
    env_file:
      - .env
    networks:
      - my-network
    volumes:
      - ./scripts/webserver:/docker-entrypoint-init.d

volumes:
  postgres_data:
networks:
  my-network:
    external: true
  • Ports are temporarily exposed until the defence:
HOST_MACHINE_AIRFLOW_SERVER_PORT="8080"
CONTAINER_AIRFLOW_SERVER_PORT="8080"

Tag summary

Content type

Image

Digest

sha256:12c76ee12…

Size

261.3 MB

Last updated

about 2 years ago

docker pull stiborv/etl-webserver