LLM as a System Service on Mobile Devices

Wangsong Yin, Mengwei Xu, Yuanchun Li +1

Being more powerful and intrusive into user-device interactions, LLMs are eager for on-device execution to better preserve user privacy. In this work, we propose a new paradigm of…