3 papers
cs.LG2019
XPipe: Efficient Pipeline Model Parallelism for Multi-GPU DNN Training
Lei Guan, Wotao Yin, Dongsheng Li +1
We propose XPipe, an efficient asynchronous pipeline model parallelism approach for multi-GPU DNN training. XPipe is designed to use multiple GPUs to concurrently and continuously…
math.OC2018
Non-ergodic Convergence Analysis of Heavy-Ball Algorithms
Tao Sun, Penghang Yin, Dongsheng Li +3
In this paper, we revisit the convergence of the Heavy-ball method, and present improved convergence complexity results in the convex setting. We provide the first non-ergodic O(1/…
stat.ML2018
An Efficient ADMM-Based Algorithm to Nonconvex Penalized Support Vector Machines
Lei Guan, Linbo Qiao, Dongsheng Li +3
Support vector machines (SVMs) with sparsity-inducing nonconvex penalties have received considerable attentions for the characteristics of automatic classification and variable sel…