Overview
FastChat offers end-to-end tooling: fine-tuning recipes, benchmarking (MT-Bench), and a scalable serving stack with OpenAI-compatible APIs and web UI.
Key Capabilities
- Distributed multi-model serving with dynamic routing
- One-click Vicuna training scripts & evaluation harness
- Chatbot Arena integration and Elo leaderboard
- vLLM & xFasterTransformer back-ends for high TPS
- REST/GRPC APIs plus React/Web UI frontend
