45 citations · 46 across the 2 of their papers we have counts for
2 papers
cs.DC2020★ 45 cited
TensorOpt: Exploring the Tradeoffs in Distributed DNN Training with Auto-Parallelism
Zhenkun Cai, Kaihao Ma, Xiao Yan +5
A good parallelization strategy can significantly improve the efficiency or reduce the cost for the distributed training of deep neural networks (DNNs). Recently, several methods h…
cs.DC2019★ 1 cited
Elastic deep learning in multi-tenant GPU cluster
Yidi Wu, Kaihao Ma, Xiao Yan +6
We study how to support elasticity, i.e., the ability to dynamically adjust the parallelism (number of GPUs), for deep neural network (DNN) training. Elasticity can benefit multi-t…