17 papers
Movable-Antenna Assisted Energy Minimization in UAV-Enabled Mobile Edge Computing Systems
Jiang Chen, Chunjie Wang, Xuhui Zhang +3
Driven by the exponential growth of latency-sensitive applications, mobile edge computing (MEC) has emerged as a pivotal paradigm, yet mitigating its substantial energy consumption…
CoCoScale: Leveraging Layer-wise Scaling to Unlock the Potential of Online LLM Serving
Jingfeng Wu, Yiyuan He, Minxian Xu +7
Online large language model (LLM) serving has become the backbone of modern AI applications, powering diverse downstream services through shared hardware clusters. However, modern…
BrownoutMoE: Structure-Aware Expert Grouping for Efficient and Accurate LLM Web-based Services
Yi Ding, Minxian Xu, Zhengxin Fang +2
Mixture-of-Experts (MoE) large language models (LLMs) are increasingly deployed in Web-facing services, where inference must be both accurate and responsive under bursty demand. Al…
FlexPipe: Adapting Dynamic LLM Serving Through Inflight Pipeline Refactoring in Fragmented Serverless Clusters
Yanying Lin, Shijie Peng, Chengzhi Lu +2
Serving Large Language Models (LLMs) in production faces significant challenges from highly variable request patterns and severe resource fragmentation in serverless clusters. Curr…
Memory Centric Power Allocation for Multi-Agent Embodied Question Answering
Chengyang Li, Shuai Wang, Kejiang Ye +5
This paper considers multi-agent embodied question answering (MA-EQA), which enables robot teams to answer queries based on their long-horizon observations. In contrast to existing…
Cloud-native and Distributed Systems for Efficient and Scalable Large Language Models -- A Research Agenda
Minxian Xu, Jingfeng Wu, Shengye Song +16
The rapid rise of Large Language Models (LLMs) has revolutionized various artificial intelligence (AI) applications, from natural language processing to code generation. However, t…