The Implicit Bias of Gradient Descent on Generalized Gated Linear Networks

Samuel Lippl, L. F. Abbott, SueYeon Chung

Understanding the asymptotic behavior of gradient-descent training of deep neural networks is essential for revealing inductive biases and improving network performance. We derive…