On the Convergence of Overparameterized Problems: Inherent Properties of the Compositional Structure of Neural Networks

Arthur Castello Branco de Oliveira, Dhruv Jatkar, Eduardo Sontag

This paper investigates how the compositional structure of neural networks shapes their optimization landscape and training dynamics. We analyze the gradient flow associated with o…