4 papers
Joint Optimization of DNN Model Caching and Request Routing in Mobile Edge Computing
Shuting Qiu, Fang Dong, Siyu Tan +4
Mobile edge computing (MEC) can pre-cache deep neural networks (DNNs) near end-users, providing low-latency services and improving users' quality of experience (QoE). However, cach…
Diagnosing and Repairing Distributed Routing Configurations Using Selective Symbolic Simulation
Rulan Yang, Gao Han, Hanyang Shao +9
Although substantial progress has been made in automatically verifying whether distributed routing configurations conform to certain requirements, diagnosing and repairing configur…
Remoe: Towards Efficient and Low-Cost MoE Inference in Serverless Computing
Wentao Liu, Yuhao Hu, Ruiting Zhou +2
Mixture-of-Experts (MoE) has become a dominant architecture in large language models (LLMs) due to its ability to scale model capacity via sparse expert activation. Meanwhile, serv…
AutoTailor: Automatic and Efficient Adaptive Model Deployment for Diverse Edge Devices
Mengyang Liu, Chenyu Lu, Haodong Tian +7
On-device machine learning (ML) has become a fundamental component of emerging mobile applications. Adaptive model deployment delivers efficient inference for heterogeneous device…