37 citations · 43 across the 5 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 1 cited
Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression
Jingfeng Wu, Difan Zou, Vladimir Braverman +2
Stochastic gradient descent (SGD) has been shown to generalize well in many deep learning applications. In practice, one often runs SGD with a geometrically decaying stepsize, i.e.…
cs.LG2021★ 4 cited
Lifelong Learning with Sketched Structural Regularization
Haoran Li, Aditya Krishnan, Jingfeng Wu +3
Preventing catastrophic forgetting while continually learning new tasks is an essential problem in lifelong learning. Structural regularization (SR) refers to a family of algorithm…