On Spectral Bias Reduction of Multi-scale Neural Networks for Regression Problems

Bo Wang, Heng Yuan, Lizuo Liu +2

In this paper, we derive diffusion equation models in the spectral domain for the evolution of training errors of two-layer multi-scale deep neural networks (MscaleDNN) \cite{caixu…