The critical locus of overparameterized neural networks

Y. Cooper

Many aspects of the geometry of loss functions in deep learning remain mysterious. In this paper, we work toward a better understanding of the geometry of the loss function $L$ of…