6 papers
Online Feedback Optimization for Constrained Stochastic Problems with Decision-Dependent Distributions: Extended Version
Caio Kalil Lauand, Emiliano Dall'Anese
Online feedback optimization (OFO) leverages real-time output measurements to optimize the operation of networked systems without requiring full knowledge of system dynamics or dis…
The case for and against fixed step-size: Stochastic approximation algorithms in optimization and machine learning
Caio Kalil Lauand, Ioannis Kontoyiannis, Sean Meyn
Theory and application of stochastic approximation (SA) have become increasingly relevant due in part to applications in optimization and reinforcement learning. This paper takes a…
Global Convergence and Acceleration for Single Observation Gradient Free Optimization
Caio Kalil Lauand, Sean Meyn
Simultaneous perturbation stochastic approximation (SPSA) is an approach to gradient-free optimization introduced by Spall as a simplification of the approach of Kiefer and Wolfowi…
Stochastic Online Feedback Optimization for Networks of Non-Compliant Agents
Caio Kalil Lauand, Andrey Bernstein
In several applications of online optimization to networked systems such as power grids and robotic networks, information about the system model and its disturbances is not general…
Revisiting Step-Size Assumptions in Stochastic Approximation
Caio Kalil Lauand, Sean Meyn
Many machine learning and optimization algorithms are built upon the framework of stochastic approximation (SA), for which the selection of step-size (or learning rate) …
Markovian Foundations for Quasi-Stochastic Approximation in Two Timescales: Extended Version
Caio Kalil Lauand, Sean Meyn
Many machine learning and optimization algorithms can be cast as instances of stochastic approximation (SA). The convergence rate of these algorithms is known to be slow, with the…