2 papers
cs.DC2025
ElasticMoE: An Efficient Auto Scaling Method for Mixture-of-Experts Models
Gursimran Singh, Timothy Yu, Haley Li +7
Mixture-of-Experts (MoE) models promise efficient scaling of large language models (LLMs) by activating only a small subset of experts per token, but their parallelized inference p…
cs.DC2025
Efficiently Serving Large Multimodal Models Using EPD Disaggregation
Gursimran Singh, Xinglu Wang, Yifan Hu +9
Large Multimodal Models (LMMs) extend Large Language Models (LLMs) by handling diverse inputs such as images, audio, and video, but at the cost of adding a multimodal encoding stag…