Is the Skip Connection Provable to Reform the Neural Network Loss Landscape?

Lifu Wang, Bo Shen, Ning Zhao +1

The residual network is now one of the most effective structures in deep learning, which utilizes the skip connections to ``guarantee" the performance will not get worse. However,…