Divergence of Empirical Neural Tangent Kernel in Classification Problems

Zixiong Yu, Songtao Tian, Guhan Chen

This paper demonstrates that in classification problems, fully connected neural networks (FCNs) and residual neural networks (ResNets) cannot be approximated by kernel logistic reg…