Frequency Principle in Deep Learning with General Loss Functions and Its Potential Application

Zhi-Qin John Xu

Previous studies have shown that deep neural networks (DNNs) with common settings often capture target functions from low to high frequency, which is called Frequency Principle (F-…