myminifactory/task-actioner
Task Actioner is a RabbitMQ comsumer that receives task messages and runs them
Image
0
2.2K
myminifactory/task-actioner repository overview
Task Actioner
Task Actioner is a RabbitMQ comsumer that receives task messages and runs them as native or docker actions
Consumer role
- Always on - never crash or restart on crash
- Consumes rabbitMQ
- Read the message (i.e. payload-example.json)
- Download the required files
- Read the type of task to call the right action if it's a docker container:
- mount the right volumes
- convert the params as args
Two types of actions:
- Built in code (faster/reliable)
- call of Docker image (GitHub actions-like)
Use Task Actioner Docker image
Pull image
docker pull myminifactory/task-actioner
Environment variable
Here are all the environment variables you need to run the container:
| Variable name | Description | Default value |
|---|---|---|
| MMF_API_BASE_URL | The base url of your MyMiniFactory instance | null |
| MMF_API_SECRET_KEY | Your access token to use your MyMiniFactory instance | null |
| FILE_STORAGE_HOST | The url of your storage service | null |
| FILE_STORAGE_PORT | The port of you storage service | null |
| FILE_STORAGE_USE_SSL | put it to true if you want to use SSL to communicate with your storage service | null |
| FILE_STORAGE_ACCESS_KEY | The login of your storage service | null |
| FILE_STORAGE_SECRET_KEY | The password of your storage service | null |
| RABBITMQ_HOST | The url of your RabbitMQ service | null |
| RABBITMQ_PORT | The port of your storage service | null |
| RABBITMQ_USE_SSL | set true if you want to use AMQPS to communicate with RabbitMQ AMQP otherwise | |
| RABBITMQ_USER | The login of your storage service | null |
| RABBITMQ_PASSWORD | The password of your storage service | null |
| UID | The user id of the user to manipulate your file in the container launched with docker actions | 1000 |
| GID | The group id of the user to manipulate your file in the container launched with docker actions | 1000 |
| UNAME | The name of the user to manipulate your file in the container launched with docker actions | worker |
| TASK_ACTIONER_PATH | The location of your task actioner application | null |
| SIMULTANEOUS_TASKS | Number of concurrent tasks | 1 |
Run the tests suite
Start the test environment
Go into the tests directory and run docker-compose specifying the environment variable TASK_ACTIONER_PATH, RABBITMQ_PORT, FILE_STORAGE_ACCESS_KEY and FILE_STORAGE_SECRET_KEY
TASK_ACTIONER_PATH=<task_actioner_path> RABBITMQ_PORT=<rabbitmq_port> FILE_STORAGE_ACCESS_KEY=<access_key> FILE_STORAGE_SECRET_KEY=<secret_key> docker-compose up -d
Go back tot the root the repository
Install the the test actions with docker and npm:
docker build -t zip -f tests/actions/zip/Dockerfile tests/actions/zip/
npm i tests/actions/unzip
Now you can run:
npm test
TODO
- Plug the consumer to rabbitMQ
- Build docker image if it doesn't exist
- Rebuild in Rust
- Handle errors nicely and log!
- Handle progress feedback of tasks
Tag summary
Content type
Image
Digest
Size
153.2 MB
Last updated
over 6 years ago
docker pull myminifactory/task-actioner