24 citations · 63 across the 8 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023★ 19 cited
EdgeMoE: Empowering Sparse Large Language Models on Mobile Devices
Rongjie Yi, Liwei Guo, Shiyun Wei +3
Large language models (LLMs) such as GPTs and Mixtral-8x7B have revolutionized machine intelligence due to their exceptional abilities in generic ML tasks. Transiting LLMs from dat…
cs.LG2022★ 24 cited
STI: Turbocharge NLP Inference at the Edge via Elastic Pipelining
Liwei Guo, Wonkyo Choe, Felix Xiaozhu Lin
Natural Language Processing (NLP) inference is seeing increasing adoption by mobile applications, where on-device inference is desirable for crucially preserving user data privacy…