Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
FastEEP: Fast Intra-Instance Elastic Scaling for Expert-Parallel MoE Serving
Yunfei Feng, Jingkai He, Shiqi Liu +3
Large-scale expert parallelism (EP) has become the standard deployment configuration for Mixture-of-Experts (MoE) models in production. Meanwhile, the highly dynamic nature of LLM…
cs.DC2024
Jiagu: Optimizing Serverless Computing Resource Utilization with Harmonized Efficiency and Practicability
Qingyuan Liu, Yanning Yang, Dong Du +5
Current serverless platforms struggle to optimize resource utilization due to their dynamic and fine-grained nature. Conventional techniques like overcommitment and autoscaling fal…