Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data

Dibyakanti Kumar, Samyak Jha, Anirbit Mukherjee

In this work, we will establish that the Langevin Monte-Carlo algorithm can learn depth-2 neural nets of any size and for any data and we give non-asymptotic convergence rates for…