Minimum weight norm models do not always generalize well for over-parameterized problems

Vatsal Shah, Anastasios Kyrillidis, Sujay Sanghavi

This work is substituted by the paper in arXiv:2011.14066. Stochastic gradient descent is the de facto algorithm for training deep neural networks (DNNs). Despite its popularity, i…