HUB
Sign inSign up

kvcacheai/mooncake

Sponsored OSS

By kvcacheai

•Updated 16 days ago

kvcache-ai Mooncake community official image.

Image
0

10K+

kvcacheai/mooncake repository overview

Mooncake is an open-source KVCache-centric infrastructure project for large-scale LLM serving. It provides a disaggregated serving architecture, high-performance data transfer, and distributed KVCache management to help AI infrastructure teams improve inference throughput, resource utilization, and reliability for production-scale workloads.

Source code: https://github.com/kvcache-ai/mooncake⁠

Documentation: https://kvcache-ai.github.io/Mooncake/⁠

Tag summary

Content type

Image

Digest

sha256:43b0ae9d1…

Size

105.3 MB

Last updated

16 days ago

docker pull kvcacheai/mooncake

This week's pulls

Pulls:

356

Last week