WiLLM: an Open Framework for LLM Services over Wireless Systems

Boyi Liu, Yongguang Lu, Jianguo Zhao +5

Large Language Model (LLM) services fundamentally differ from traditional Deep Neural Network (DNN) applications in wireless networks. We identify three critical distinctions: (1)…