llmcompression/llmc repository overview

This is a docker image repository for LLMC⁠, which is a tool for LLM compression.

⁠Tag:

pure-latest: Only llmc in docker image.

⁠Usage:

docker pull llmcompression/llmc:[tag]

docker run --gpus all -itd --ipc=host --name [container name] -v [local path]:[container path] --entrypoint /bin/bash [image id]

docker start -i [container name]

conda activate torch231

You can use pip list in the container to check the packages installed.

You can find calib/eval datasets at /home/datasets/llmc.zip

cd /home/datasets
unzip llmc.zip

⁠For China docker hub

If you need acceleration docker image source in China, you can pull image like this:

docker pull registry.cn-hangzhou.aliyuncs.com/yongyang/llmcompression:[tag]