works on
Barzilai-Borwein hybrid 1gradient methods 1step size selection 1twin-step principle 1unconstrained optimization 1

From the 1 of 7 linked papers with an AI index.

activity
20242026
collaborators
Showing stat.MLShow all

1 paper · 1 filter

stat.ML2025

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality

Lu Xia, Michiel E. Hochstenbach, Stefano Massei

When training neural networks with low-precision computation, rounding errors often cause stagnation or are detrimental to the convergence of the optimizers; in this paper we study…