1 citations · 2 across the 8 of their papers we have counts for
Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
FuxiShuffle: An Adaptive and Resilient Shuffle Service for Distributed Data Processing on Alibaba Cloud
Yuhao Lin, Zhipeng Tang, Jiayan Tong +11
Shuffle exchanges intermediate results between upstream and downstream operators in distributed data processing and is usually the bottleneck due to factors such as small random I/…
cs.DC2023★ 1 cited
SPT: Fine-Tuning Transformer-based Language Models Efficiently with Sparsification
Yuntao Gui, Xiao Yan, Peiqi Yin +2
Transformer-based large language models (e.g., BERT and GPT) achieve great success, and fine-tuning, which tunes a pre-trained model on a task-specific dataset, is the standard pra…
cs.DC2019★ 1 cited
Elastic deep learning in multi-tenant GPU cluster
Yidi Wu, Kaihao Ma, Xiao Yan +6
We study how to support elasticity, i.e., the ability to dynamically adjust the parallelism (number of GPUs), for deep neural network (DNN) training. Elasticity can benefit multi-t…