The oringinal repo is here: https://github.com/lm-sys/FastChat
FastChat is an open platform for training, serving, and evaluating large language model based chatbots. The core features include:
- The weights, training code, and evaluation code for state-of-the-art models (e.g., Vicuna, FastChat-T5).
- A distributed multi-model serving system with web UI and OpenAI-compatible RESTful APIs.
46c661b0ac8d530959e728781a073f44_0_1688621579.mp4
- [2023/06] 🔥 We introduced LongChat, our long-context chatbots and evaluation tools. Check out the blog post and code.
- [2023/05] We introduced Chatbot Arena for battles among LLMs. Check out the blog post and demo.
- [2023/04] We released FastChat-T5 compatible with commercial usage. Check out the weights and demo.
- [2023/03] We released Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90% ChatGPT Quality. Check out the blog post and demo.
- Install
- Model Weights
- Inference with Command Line Interface
- Serving with Web GUI
- API
- Evaluation
- Fine-tuning
- Citation
pip3 install fschat- Clone this repository and navigate to the FastChat folder
git clone https://github.com/lm-sys/FastChat.git
cd FastChatIf you are running on Mac:
brew install rust cmake- Install Package
pip3 install --upgrade pip # enable PEP 660 support
pip3 install -e .