On the Empirical Neural Tangent Kernel of Standard Finite-Width Convolutional Neural Network Architectures

Maxim Samarin, Volker Roth, David Belius

The Neural Tangent Kernel (NTK) is an important milestone in the ongoing effort to build a theory for deep learning. Its prediction that sufficiently wide neural networks behave as…