Base environment for experimenting locally with LLMs
655
llm-environmentBuilt from releases at https://github.com/NightShift-Codes/llm-environment
These images provide CUDA 12.2 along with Torch and HF Transformers.
Run with a command like:
docker run -it --rm --gpus all --network host -v "./notebooks:/home/user/llm-environment/notebooks" nightshiftcodes/llm-environment:intro
Each tag is intended to go along with a separate entry in the Medium blog post series, "Getting Started with LLMs".
nightshiftcodes/llm-environment:intro: Companion image for https://medium.com/nightshift-codes/getting-started-with-llms-d75a5cd370cbnightshiftcodes/llm-environment:llava: Companion image for https://medium.com/nightshift-codes/run-llava-v1-6-locally-48bfc68265dbContent type
Image
Digest
sha256:804ac9c58…
Size
5.6 GB
Last updated
over 2 years ago
docker pull nightshiftcodes/llm-environment