86 citations · 118 across the 7 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
math.OC2016★ 86 cited
Unified Convergence Analysis of Stochastic Momentum Methods for Convex and Non-convex Optimization
Tianbao Yang, Qihang Lin, Zhe Li
Recently, {\it stochastic momentum} methods have been widely adopted in training deep neural networks. However, their convergence analysis is still underexplored at the moment, in…
cs.LG2016★ 11 cited
Improved Dropout for Shallow and Deep Learning
Zhe Li, Boqing Gong, Tianbao Yang
Dropout has been witnessed with great success in training deep neural networks by independently zeroing out the outputs of neurons at random. It has also received a surge of intere…