Sign inSign up
M

Malav Patel

Community User

Displaying 1 to 6 of 6 repositories

image

An image for serving zai.org/GLM-5.3-Flash on SM80. Single request decode 93 tok/s on 8xA100-80GB.

3d

2.2K

image

vLLM image for XiaomiMiMo/MiMo-V2.6-Flash-RL on SM80. Single request decode 100 tok/s on 8xA100-40GB

7d

436

image

An image for serving GLM 5.2 (lowbitcoffee/GLM-5.2-W4A16) on NVIDIA SM80 architecture via vLLM.

23d

277