Why Shallow Networks Struggle to Approximate and Learn High Frequencies

Shijun Zhang, Hongkai Zhao, Yimin Zhong +1

In this work, we present a comprehensive study combining mathematical and computational analysis to explain why a two-layer neural network struggles to handle high frequencies in b…