Frequency Principle in Deep Learning Beyond Gradient-descent-based Training

Yuheng Ma, Zhi-Qin John Xu, Jiwei Zhang

Frequency perspective recently makes progress in understanding deep learning. It has been widely verified in both empirical and theoretical studies that deep neural networks (DNNs)…