Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories

Haobo Zhang, Jianfa Lai, Yicheng Li +2

A primary advantage of neural networks lies in their feature learning characteristics, which is challenging to theoretically analyze due to the complexity of their training dynamic…