This will let you run Vulkan on Vega 11 Amd graphics with your llama.cpp server using MiniCPM-V-4.6
144
This has been tested on Ryzen 2400ge with integrated graphics and 16gb of ram.
Here is premade yaml file to use for full setup.
https://cuttachasebeats.com/downloads/llama.cpp__Vulkan___Vega_11_.yaml.zip
Content type
Image
Digest
sha256:0e1942509…
Size
166.7 MB
Last updated
30 days ago
docker pull cuttachasebeats/llama-vulkan-vega11