A spectral-based analysis of the separation between two-layer neural networks and linear methods

Lei Wu, Jihao Long

We propose a spectral-based approach to analyze how two-layer neural networks separate from linear methods in terms of approximating high-dimensional functions. We show that quanti…