Sign inSign up

garenleeasa/lsglang

By garenleeasa

•Updated 16 days ago

https://github.com/guqiong96/Lsglang

Image
Machine learning & AI
0

8.9K

garenleeasa/lsglang repository overview

Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.

Tag summary

Content type

Image

Digest

sha256:de49f150b…

Size

11.9 GB

Last updated

16 days ago

docker pull garenleeasa/lsglang:v1.5.6