toughcoding/ollama-codellama repository overview

⁠Codellama via ollama

Fat docker image with codellama 7b model included.

image is signed so you can enforce pulling only signed images export DOCKER_CONTENT_TRUST=1

to run

docker run -d  -p 11434:11434 --name ollama-codellama toughcoding/ollama-codellama:7b
docker exec -it ollama-codellama ollama run codellama:7b

It will open up console to chat and from that point onwards you can integrate it with IDE plugins for code support

⁠For Nvidia users

Make sure to Install the Nvidia container toolkit⁠ then run with gpu option

docker run -d --gpus=all -p 11434:11434 --name ollama-codellama toughcoding/ollama-codellama:7b
docker exec -it ollama-codellama ollama run codellama:7b