An image for running GPULlama3.java with TornadoVM NVIDIA GPUs with OpenCL.
604
docker pull beehivelab/gpullama3.java-nvidia-openjdk-opencl:latest
git clone https://github.com/beehive-lab/docker-gpullama3.java
cd docker-gpullama3.java
wget https://huggingface.co/beehive-lab/Llama-3.2-1B-Instruct-GGUF-FP16/resolve/main/beehive-llama-3.2-1b-instruct-fp16.gguf
./dockerized-llama-tornado-nvidia-opencl \
--gpu --opencl --verbose-init \
--model beehive-llama-3.2-1b-instruct-fp16.gguf \
--prompt "tell me a joke"
Sample Output:
Here's one: What do you call a fake noodle? An impasta!
Content type
Image
Digest
sha256:9c1d37ad7…
Size
2.3 GB
Last updated
11 months ago
docker pull beehivelab/gpullama3.java-nvidia-openjdk-opencl