The global optimum of shallow neural network is attained by ridgelet transform

Sho Sonoda, Isao Ishikawa, Masahiro Ikeda +4

We prove that the global minimum of the backpropagation (BP) training problem of neural networks with an arbitrary nonlinear activation is given by the ridgelet transform. A series…