https://github.com/FlashML-org/FreeToken
656
FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine designed for running frontier-scale open-weight models on personal and consumer hardware. It treats heterogeneous edge resources—GPUs, CPUs, host memory, and interconnects—as a unified, elastic inference platform.
Content type
Image
Digest
sha256:9c511a890…
Size
9.7 GB
Last updated
15 days ago
docker pull garenleeasa/freetoken:v0.1.3-cuda_13.2.1