Unsloth on Containers. Finetune Llama 3.2, Mistral, Phi-3.5 faster with 80% less memory!
1.1K
Finetune Llama 3.2, Mistral, Phi-3.5 & Gemma 2-5x faster with 80% less memory!
Based on nvidia/cuda:12.5.1-devel-ubuntu22.04 with nvidia/cuda:12.5.1-runtime-ubuntu22.04 for the runtime.
🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
==((====))== Unsloth 2024.10.7: Fast Llama patching. Transformers = 4.46.1.
\\ /| GPU: NVIDIA RTX A6000. Max memory: 47.436 GB. Platform = Linux.
O^O/ \_/ \ Pytorch: 2.3.1+cu121. CUDA = 8.6. CUDA Toolkit = 12.1.
\ / Bfloat16 = TRUE. FA [Xformers = 0.0.27. FA2 = True]
"-____-" Free Apache license: http://github.com/unslothai/unsloth
Content type
Image
Digest
sha256:7a355a888…
Size
7.3 GB
Last updated
almost 2 years ago
docker pull barrahome/unsloth-container