1 citations · 1 across the 9 of their papers we have counts for
4 papers · 1 filter
DualPace: Decoupled Scheduling and Cooperative GPU--CPU Decoding for LLM Serving
YuXuan Lin, KeQiang Wu, Kingsum Chow
Large language model (LLM) serving relies on batching to improve inference throughput, but the key-value (KV) cache grows with sequence length and limits GPU-resident concurrency.…
Prediction-Robust Service Deployment with Capacity-Aware Edge Admission
Hailiang Zhao, Ziqi Wang, Yifei Zhang +4
Edge platforms instantiate executable services close to users to reduce request-serving cost, but each instance incurs a one-time deployment cost and remains useful only for a fini…
Morphis: SLO-Aware Resource Scheduling for Microservices with Time-Varying Call Graphs
Yu Tang, Hailiang Zhao, Chuansheng Lu +4
Modern microservice systems exhibit continuous structural evolution in their runtime call graphs due to workload fluctuations, fault responses, and deployment activities. Despite t…
Adaptive Dual-Weighting Framework for Federated Learning via Out-of-Distribution Detection
Zhiwei Ling, Hailiang Zhao, Chao Zhang +8
Federated Learning (FL) enables collaborative model training across large-scale distributed service nodes while preserving data privacy, making it a cornerstone of intelligent serv…