3 papers
cs.LG2020
Is the Skip Connection Provable to Reform the Neural Network Loss Landscape?
Lifu Wang, Bo Shen, Ning Zhao +1
The residual network is now one of the most effective structures in deep learning, which utilizes the skip connections to ``guarantee" the performance will not get worse. However,…
cs.LG2019
Second-Order Convergence of Asynchronous Parallel Stochastic Gradient Descent: When Is the Linear Speedup Achieved?
Lifu Wang, Bo Shen, Ning Zhao
In machine learning, asynchronous parallel stochastic gradient descent (APSGD) is broadly used to speed up the training process through multi-workers. Meanwhile, the time delay of…
math.PR2018
The asymptotic behaviors of self excitation information diffusion processes for a large number of individuals
Lifu Wang, Bo Shen
The dynamics of opinion is a complex and interesting process, especially for the systems with large number individuals. It is usually hard to describe the evolutionary features of…