Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributions

Jaeyong Bae, Hawoong Jeong

Analyzing neural network dynamics via stochastic gradient descent (SGD) is crucial to building theoretical foundations for deep learning. Previous work has analyzed structured inpu…