https://github.com/guqiong96/Lsglang
8.9K
Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
Content type
Image
Digest
sha256:de49f150b…
Size
11.9 GB
Last updated
16 days ago
docker pull garenleeasa/lsglang:v1.5.6