leadingfellows/celery_worker_base repository overview

Base image for running Celery and Flower.

Flower is only included in extended and flower tags. The extended images include more python3 libraries such as pandas, numpy..etc

⁠Celery

⁠environment variables and default values

• CELERY_BROKER_URL redis://localhost:6379
• CELERY_RESULT_BACKEND redis://localhost:6379
• CELERY_LOG_LEVEL info
• CELERY_STATE_DB /celery_worker/var/statedb
• CELERY_AUTOSCALE 10,3
• CELERY_COMMANDLINE_ARGUMENTS

⁠command line

• --app=main worker"
• --loglevel=${CELERY_LOG_LEVEL}
• --statedb=${CELERY_STATE_DB}"
• --autoscale=${CELERY_AUTOSCALE}"
• ${CELERY_COMMANDLINE_ARGUMENTS}"

⁠Flower

⁠environment variables and default values

• FLOWER_INTERNAL_PORT 5555
• CELERY_BROKER_URL redis://redis:6379/0
• FLOWER_URL_PREFIX
• FLOWER_COMMANDLINE_ARGUMENTS

⁠command line

• --port=${FLOWER_INTERNAL_PORT:-5555}
• --broker=${CELERY_BROKER_URL:-redis://redis:6379/0}
• --url_prefix=${FLOWER_URL_PREFIX:-}"
• ${FLOWER_COMMANDLINE_ARGUMENTS:-}"

⁠Example docker-compose file

version: "3.4"
services:
  celery:
    image: leadingfellows/celery_worker_base:flower
    ports:
      - "5555:5555"
    environment:
      - FLOWER_INTERNAL_PORT=5555
      - CELERY_BROKER_URL=redis://redis:6379
      - CELERY_RESULT_BACKEND=redis://redis:6379
    depends_on:
      - redis
  redis:
    image: redis