Federated Inference for Heterogeneous LLM Communication and Collaboration

Zihan Chen, Zeshen Li, Howard H. Yang +2

Given the limited performance and efficiency of on-device Large Language Models (LLMs), the collaborations between multiple LLMs enable desirable performance enhancements, in which…