EdgeFlow: Fast Cold Starts for LLMs on Mobile Devices

Yongsheng Yan, Jiacheng Shen, Xuchuan Luo +1

Deploying large language models (LLMs) on mobile devices is an emerging trend to enable data privacy and offline accessibility of LLM applications. Modern mobile neural processing…