Sign inSign up

garenleeasa/ktransformers

By garenleeasa

•Updated 3 months ago

https://github.com/kvcache-ai/ktransformers

Image
Machine learning & AI
0

1.8K

garenleeasa/ktransformers repository overview

About A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Tag summary

Content type

Image

Digest

sha256:3bdb875b2…

Size

10.3 GB

Last updated

3 months ago

docker pull garenleeasa/ktransformers:v0.6.3