From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks

Clémentine C. J. Dominé, Nicolas Anguita, Alexandra M. Proca +4

Biological and artificial neural networks develop internal representations that enable them to perform complex tasks. In artificial networks, the effectiveness of these models reli…