Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs
Yixuan Mei, Zikun Li, Zixuan Chen +5
The usage of large language models (LLMs) has grown increasingly fragmented, with no single model dominating. Meanwhile, cloud providers offer a wide range of mid-tier and older-ge…
cs.DC2023
OSP: Boosting Distributed Model Training with 2-stage Synchronization
Zixuan Chen, Lei Shi, Xuandong Liu +3
Distributed deep learning (DDL) is a promising research area, which aims to increase the efficiency of training deep learning tasks with large size of datasets and models. As the c…
cs.DC2023
Boosting Distributed Machine Learning Training Through Loss-tolerant Transmission Protocol
Zixuan Chen, Lei Shi, Xuandong Liu +3
Distributed Machine Learning (DML) systems are utilized to enhance the speed of model training in data centers (DCs) and edge nodes. The Parameter Server (PS) communication archite…