Gaussian mixture layers for neural networks

Sinho Chewi, Philippe Rigollet, Yuling Yan

The mean-field theory for two-layer neural networks considers infinitely wide networks that are linearly parameterized by a probability measure over the parameter space. This nonpa…