259 citations · 2.9k across the 123 of their papers we have counts for
Showing 2021 · stat.MLShow all
2 papers · 2 filters
stat.ML2021★ 1 cited
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers
Liam Hodgkinson, Umut Şimşekli, Rajiv Khanna +1
Despite the ubiquitous use of stochastic optimization algorithms in machine learning, the precise impact of these algorithms and their dynamics on generalization performance in rea…
stat.ML2021★ 6 cited
Hessian Eigenspectra of More Realistic Nonlinear Models
Zhenyu Liao, Michael W. Mahoney
Given an optimization problem, the Hessian matrix and its eigenspectrum can be used in many ways, ranging from designing more efficient second-order algorithms to performing model…