6 citations · 12 across the 2 of their papers we have counts for
3 papers
cs.LG2022★ 6 cited
DELTA: Dynamically Optimizing GPU Memory beyond Tensor Recomputation
Yu Tang, Chenyu Wang, Yufan Zhang +5
The further development of deep neural networks is hampered by the limited GPU memory resource. Therefore, the optimization of GPU memory resources is highly demanded. Swapping and…
cs.NE2021★ 6 cited
Collective Intelligence for Deep Learning: A Survey of Recent Developments
David Ha, Yujin Tang
In the past decade, we have witnessed the rise of deep learning to dominate the field of artificial intelligence. Advances in artificial neural networks alongside corresponding adv…
cs.LG2020
P-ADMMiRNN: Training RNN with Stable Convergence via An Efficient and Paralleled ADMM Approach
Yu Tang, Zhigang Kan, Dequan Sun +4
It is hard to train Recurrent Neural Network (RNN) with stable convergence and avoid gradient vanishing and exploding problems, as the weights in the recurrent unit are repeated fr…