Search Docker Hub
llama2-webui
By zhangp365
Include the llama2-7b model and use gptq quantization. Ensure you run it on gpu above 8GB of VRAM.
763
Content type
Image
Digest
sha256:06e5d6660…
Size
6.5 GB
Last updated
almost 3 years ago
docker pull zhangp365/llama2-webui:v0.1