3 papers
math.OC2026
Optimal Nonergodic Primal-Dual Complexity of Efficient Inexact Parameter-Free Augmented Lagrangian Methods
Arnesh Sujanani, Saeed Ghadimi, Henry WoÅkowicz +1
Augmented Lagrangian (AL) methods are a classical framework for constrained optimization, but for directly verifiable approximate KKT points, known first-order complexity bounds fo…
math.OC2026
Optimal Diagonal Preconditioning Beyond Worst-Case Conditioning: Theory and Practice of Omega Scaling
Saeed Ghadimi, Woosuk L. Jung, Arnesh Sujanani +2
We study optimal diagonal preconditioning using the classical worst-case -condition number and the averaging-based -condition number. For the -optimal preconditioning p…
math.OC2025
Optimal Zeroth-Order Bilevel Optimization
Alireza Aghasi, Jeongyeol Kwon, Saeed Ghadimi
In this paper, we develop zeroth-order algorithms with provably (nearly) optimal sample complexity for stochastic bilevel optimization, where only noisy function evaluations are av…