LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

Junchen Zhao, Yurun Song, Simeng Liu +2

Deploying Large Language Models (LLMs) locally on mobile devices presents a significant challenge due to their extensive memory requirements. In this paper, we introduce LinguaLink…