CoServe: Efficient Collaboration-of-Experts (CoE) Model Inference with Limited Memory

Jiashun Suo, Xiaojian Liao, Limin Xiao +4

Large language models like GPT-4 are resource-intensive, but recent advancements suggest that smaller, specialized experts can outperform the monolithic models on specific tasks. T…