Feature Learning Dynamics in Infinite-Depth Neural Networks

Zihan Yao, Ruoyu Wu, Tianxiang Gao

Deep neural networks have achieved remarkable success in practice, yet a mechanistic understanding of how features evolve during training remains incomplete, especially in the larg…