Sign inSign up

zdy023/llama-remote

By zdy023

Updated almost 3 years ago

For remote access to meta llama v1 deployment used by https://github.com/OpenDFM/mobile-env-expe.

Image
0

87

zdy023/llama-remote repository overview

This image provides a remote access to Meta LLaMA-13B v1 deployment. It is used by OpenDFM/mobile-env-expe.

To launch a container:

docker run --net host --ipc host --privileged --gpus all -v /path/to/weights/:/data/weights -v /path/to/logs:/data/logs zdy023/llama-remote:latest

The container will listen to ports 30500 and 30501.

Tag summary

Content type

Image

Digest

sha256:2a87e81bf

Size

2.8 GB

Last updated

almost 3 years ago

docker pull zdy023/llama-remote:v0.3