Implicit Bias of Gradient Descent on Linear Convolutional Networks

Suriya Gunasekar, Jason Lee, Daniel Soudry +1

We show that gradient descent on full-width linear convolutional networks of depth $L$ converges to a linear predictor related to the ${\ell }_{2/L}$ bridge penalty in the frequency d…