Showing stat.MLShow all
2 papers · 1 filter
stat.ML2020
When Does Preconditioning Help or Hurt Generalization?
Shun-ichi Amari, Jimmy Ba, Roger Grosse +5
While second order optimizers such as natural gradient descent (NGD) often speed up optimization, their effect on generalization has been called into question. This work presents a…
stat.ML2020
On the Optimal Weighted Regularization in Overparameterized Linear Regression
Denny Wu, Ji Xu
We consider the linear model with in the overparameterized regime . We estimate $\ma…