5 papers · 1 filter
Bilevel gradient methods and the Morse parametric qualification condition
Jérôme Bolte, Quoc-Tung Le, Edouard Pauwels +1
We introduce the Morse parametric qualification condition for bilevel programming. Generic semi-algebraic functions are Morse parametric in a piecewise sense. Thus, bilevel program…
Characterizations of inexact proximal operators
Guillaume Lauga, Samuel Vaiter
Proximal operators are now ubiquitous in non-smooth optimization. Since their introduction in the seminal work of Moreau, many papers have shown their effectiveness on a wide varie…
ZOBA: An Efficient Single-loop Zeroth-order Bilevel Optimization Algorithm
Marco Rando, Samuel Vaiter
Bilevel optimization problems consist of minimizing a value function whose evaluation depends on the solution of an inner optimization problem. These problems are typically tackled…
Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descent
Christian Daniele, Silvia Villa, Samuel Vaiter +1
Deep Equilibrium Models (DEQs) are implicit neural networks with fixed points, which have recently gained attention for learning image regularization functionals, particularly in s…
Derivatives of Stochastic Gradient Descent in parametric optimization
Franck Iutzeler, Edouard Pauwels, Samuel Vaiter
We consider stochastic optimization problems where the objective depends on some parameter, as commonly found in hyperparameter optimization for instance. We investigate the behavi…