fulldive/fastchat repository overview

FastChat is an open platform for training, serving, and evaluating large language model based chatbots.

FastChat powers Chatbot Arena (https://chat.lmsys.org/⁠), serving over 10 million chat requests for 70+ LLMs. Chatbot Arena has collected over 500K human votes from side-by-side LLM battles to compile an online LLM Elo leaderboard. FastChat's core features include:

The training and evaluation code for state-of-the-art models (e.g., Vicuna, MT-Bench). A distributed multi-model serving system with web UI and OpenAI-compatible RESTful APIs.

For more information refer to https://github.com/lm-sys/FastChat⁠