Sign inSign up

garenleeasa/freetoken

By garenleeasa

•Updated 15 days ago

https://github.com/FlashML-org/FreeToken

Image
Machine learning & AI
0

656

garenleeasa/freetoken repository overview

FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine designed for running frontier-scale open-weight models on personal and consumer hardware. It treats heterogeneous edge resources—GPUs, CPUs, host memory, and interconnects—as a unified, elastic inference platform.

Tag summary

Content type

Image

Digest

sha256:9c511a890…

Size

9.7 GB

Last updated

15 days ago

docker pull garenleeasa/freetoken:v0.1.3-cuda_13.2.1