The Implicit Bias of AdaGrad on Separable Data

Qian Qian, Xiaoyuan Qian

We study the implicit bias of AdaGrad on separable linear classification problems. We show that AdaGrad converges to a direction that can be characterized as the solution of a quad…