Landscape analysis for shallow neural networks: Complete classification of critical points for cubic activation and affine target functions

Shokhrukh Ibragimov, Ilkhom Mukhammadiev, Diyora Salimova

In this paper, we study the optimization landscape induced by the true loss for shallow polynomial neural networks (PNNs) with $\mathfrak{h}\in \mathbb{N}$ neurons on the hidden l…