1 citations · 1 across the 4 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2021★ 1 cited
On the Provable Generalization of Recurrent Neural Networks
Lifu Wang, Bo Shen, Bo Hu +1
Recurrent Neural Network (RNN) is a fundamental structure in deep learning. Recently, some works study the training process of over-parameterized neural networks, and show that ove…
cs.LG2020
Is the Skip Connection Provable to Reform the Neural Network Loss Landscape?
Lifu Wang, Bo Shen, Ning Zhao +1
The residual network is now one of the most effective structures in deep learning, which utilizes the skip connections to ``guarantee" the performance will not get worse. However,…
cs.LG2019
Second-Order Convergence of Asynchronous Parallel Stochastic Gradient Descent: When Is the Linear Speedup Achieved?
Lifu Wang, Bo Shen, Ning Zhao
In machine learning, asynchronous parallel stochastic gradient descent (APSGD) is broadly used to speed up the training process through multi-workers. Meanwhile, the time delay of…