laineil/mlflow-inference repository overview

⁠About MLflow Inference

GitHub Actions in the laineil/containers/app/pysvc⁠ project builds and pushes this image to Docker Hub.

Please visit the project documentation site for help to use and contribute to this image and others.

• MLflow Official Website⁠
• MLflow Documentation⁠
• MLflow Github⁠
• MLflow Model (models serve)⁠

⁠Image information

• The use of non-root container images can enhance system security.
• Support the TZ environment variable to set up the desired timezone (see Services top-level element⁠).
• Subscribe to project updates by watching the laineil/containers GitHub repo⁠ for more information.

⁠Configuration

The container can be easily setup with the following environment variables:

• MLF_WORKERS: Number of gunicorn worker processes to handle requests. Default: 1
• MLF_EX_MODEL: Whether to enable mlflow example model (see mlflow-example⁠) or not. Default: enable (disable)
• MLF_MODEL_URI: Set up the model URI (see Storage Format⁠). Default: exmodel
  • tip: MLF_EX_MODEL=enable <=> MLF_MODEL_URL=exmodel

⁠Run a container

• Quick start

$ docker run -it \
--name mlflow_infrence \
-p [expose_port]:5000 \
laineil/mlflow-inference:[tag]

• Recommended example

$ docker run -it \
--name mlflow_infrence \
-v [model_uri_path]:/volume/mlflow/[model_uri] \
-p [expose_port]:5000 \
-e MLF_EX_MODEL=disable \
-e MLF_MODEL_URI=[model_uri] \
laineil/mlflow-inference:[tag]

⁠Verify

• Use curl to test

$ curl -X POST http://[server_host]:[expose_port]/invocations -H "Content-Type:application/json" -d '{"dataframe_split": {"columns":["fixed acidity", "volatile acidity", "citric acid", "residual sugar", "chlorides", "free sulfur dioxide", "total sulfur dioxide", "density", "pH", "sulphates", "alcohol"],"data":[[6.2, 0.66, 0.48, 1.2, 0.029, 29, 75, 0.98, 3.33, 0.39, 12.8]]}}'

• Result

{"predictions": [x.xxxxxxxxxxxxxxx]}

⁠Logging

$ docker logs mlflow_infrence

⁠Remove

• Stop container

$ docker container stop mlflow_infrence

• Remove container

$ docker container rm mlflow_infrence

• Remove volume

$ docker volume rm mlflow_infrence

⁠License Agreement

BSD 3-Clause License
Copyright (c) 2023, Laineil
All rights reserved.