On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory

Guhan Chen, Yicheng Li, Qian Lin

This paper aims to discuss the impact of random initialization of neural networks in the neural tangent kernel (NTK) theory, which is ignored by most recent works in the NTK theory…