On the connections between algorithmic regularization and penalization for convex losses

Qian Qian, Xiaoyuan Qian

In this work we establish the equivalence of algorithmic regularization and explicit convex penalization for generic convex losses. We introduce a geometric condition for the optim…