vectorinstitute/vector-inference

•Updated 10 months ago

Efficient inference server for slurm-managed cluster using vLLM.

Image

4.0K

vectorinstitute/vector-inference repository overview

No overview available

This repository doesn't have an overview

Recent tags

Content type

Image

Digest

sha256:3eb50da1c…

Size

10.7 GB

Last updated

11 months ago

docker pull vectorinstitute/vector-inference