9 citations · 10 across the 4 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2020
Is the Skip Connection Provable to Reform the Neural Network Loss Landscape?
Lifu Wang, Bo Shen, Ning Zhao +1
The residual network is now one of the most effective structures in deep learning, which utilizes the skip connections to ``guarantee" the performance will not get worse. However,…
cs.LG2019
Second-Order Convergence of Asynchronous Parallel Stochastic Gradient Descent: When Is the Linear Speedup Achieved?
Lifu Wang, Bo Shen, Ning Zhao
In machine learning, asynchronous parallel stochastic gradient descent (APSGD) is broadly used to speed up the training process through multi-workers. Meanwhile, the time delay of…