xinference-all with local deployment.
# CPU
sudo docker run -it -d --name xinference -p 9997:9997 -v /path/to/workspace:/workspace blodely/xinference:1.0.0
# enable GPU
sudo docker run -it -d --name xinference -p 9997:9997 -v /path/to/workspace:/workspace --gpus all blodely/xinference:1.0.0
then, visit http://localhost:9997 for mgr page
Rick
December 18, 2023
Content type
Image
Digest
sha256:8e8afd8bf…
Size
11.7 GB
Last updated
over 2 years ago
docker pull blodely/xinference:1.0.0