2 papers
cs.LG2025
Scorpio: Serving Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference
Yinghao Tang, Tingfeng Lan, Bo Pan +3
Large Language Model (LLM) serving increasingly underpins online Web services such as conversational agents, Web search, and programming assistants, where requests carry heterogene…
cs.DC2023
DLRover-RM: Resource Optimization for Deep Recommendation Models Training in the Cloud
Qinlong Wang, Tingfeng Lan, Yinghao Tang +8
Deep learning recommendation models (DLRM) rely on large embedding tables to manage categorical sparse features. Expanding such embedding tables can significantly enhance model per…