2 papers
cs.LG2021
Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations
Bo Liu
In this paper, it is shown theoretically that spurious local minima are common for deep fully-connected networks and convolutional neural networks (CNNs) with piecewise linear acti…
cs.LG2020
Understanding Global Loss Landscape of One-hidden-layer ReLU Networks, Part 1: Theory
Bo Liu
For one-hidden-layer ReLU networks, we prove that all differentiable local minima are global inside differentiable regions. We give the locations and losses of differentiable local…