Criteria and Bias of Parameterized Linear Regression under Edge of Stability Regime

Peiyuan Zhang, Amin Karbasi

Classical optimization theory requires a small step-size for gradient-based methods to converge. Nevertheless, recent findings challenge the traditional idea by empirically demonst…