40 citations · 71 across the 7 of their papers we have counts for
3 papers · 1 filter
A Unified Approach to Controlling Implicit Regularization via Mirror Descent
Haoyuan Sun, Khashayar Gatmiry, Kwangjun Ahn +1
Inspired by the remarkable success of large neural networks, there has been significant interest in understanding the generalization performance of over-parameterized models. Subst…
Mirror Descent Maximizes Generalized Margin and Can Be Implemented Efficiently
Haoyuan Sun, Kwangjun Ahn, Christos Thrampoulidis +1
Driven by the empirical success and wide use of deep neural networks, understanding the generalization performance of overparameterized models has become an increasingly popular qu…
Beyond Online Balanced Descent: An Optimal Algorithm for Smoothed Online Optimization
Gautam Goel, Yiheng Lin, Haoyuan Sun +1
We study online convex optimization in a setting where the learner seeks to minimize the sum of a per-round hitting cost and a movement cost which is incurred when changing decisio…