Showing 2024Show all
3 papers · 1 filter
math.OC2024
Relaxed and Inertial Nonlinear Forward-Backward with Momentum
Fernando Roldán, Cristian Vega
In this article, we study inertial algorithms for numerically solving monotone inclusions involving the sum of a maximally monotone and a cocoercive operator. In particular, we ana…
cs.LG2024
Optimization Insights into Deep Diagonal Linear Networks
Hippolyte Labarrière, Cesare Molinari, Lorenzo Rosasco +2
Gradient-based methods successfully train highly overparameterized models in practice, even though the associated optimization problems are markedly nonconvex. Understanding the me…
math.OC2024
Delayed Feedback in Online Non-Convex Optimization: A Non-Stationary Approach with Applications
Felipe Lara, Cristian Vega
We study non-convex delayed-noise online optimization problems by evaluating dynamic regret in the non-stationary setting when the loss functions are quasar-convex. In particular,…