Showing math.OCShow all
3 papers · 1 filter
math.OC2025
Stochastic Approximation with Block Coordinate Optimal Stepsizes
Tao Jiang, Lin Xiao
We consider stochastic approximation with block-coordinate stepsizes and propose adaptive stepsize rules that aim to minimize the expected distance from the next iterate to an (unk…
math.OC2025
Bregman Douglas-Rachford Splitting Method
Shiqian Ma, Lin Xiao, Renbo Zhao
In this paper, we propose the Bregman Douglas-Rachford splitting (BDRS) method and its variant Bregman Peaceman-Rachford splitting method for solving maximal monotone inclusion pro…
math.OC2024
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
Antonio Orvieto, Lin Xiao
We consider the problem of minimizing the average of a large number of smooth but possibly non-convex functions. In the context of most machine learning applications, each loss fun…