Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data

Dibyakanti Kumar, Samyak Jha, Anirbit Mukherjee

In this note we prove that the Langevin Monte Carlo (LMC) algorithm can minimize the population risk of appropriately regularized depth-2 nets with no restrictions on the size of t…