rdmediation/phi3webgpu repository overview

⁠Phi-3 WebGPU offline

Based on Xenova/experimental-phi3-webgpu⁠ , this is a docker standalone version of phi-3-mini-4k quantized 4bits that can run offline with webgpu compatible browser (Chrome, Brave...)

The container is AMD64 but works with Apple silicon.

#Run it

• Install Docker
• run

docker -p 8000:8000 rdmediation/phi3webgpu

• Go to localhost:8000⁠

⁠Performance