Online Stochastic Optimization for Unknown Linear Systems: Data-Driven Synthesis and Controller Analysis
arXiv:2108.13040
Abstract
This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available methods critically rely on a precise knowledge of the system dynamics (thus requiring off-line system identification and model refinement). To this aim, in this paper we first show that the steady-state transfer function of a linear system can be computed directly from control experiments, bypassing explicit model identification. Then, we leverage the estimated transfer function to design a controller -- which is inspired by stochastic gradient descent methods -- that regulates the system to the solution of the prescribed optimization problem. A distinguishing feature of our methods is that they do not require any knowledge of the system dynamics, disturbance terms, or their distributions. Our technical analysis combines concepts and tools from behavioral system theory, stochastic optimization with decision-dependent distributions, and stability analysis. We illustrate the applicability of the framework on a case study for mobility-on-demand ride service scheduling in Manhattan, NY.
References in corpus (10)
- Data-Driven Model Predictive Control with Stability and Robustness Guarantees
- Online Primal-Dual Methods with Measurement Feedback for Time-Varying Convex Optimization
- Trade-offs in learning controllers from noisy data
- Maximum Likelihood Estimation in Data-Driven Modeling and Control
- Better Theory for SGD in the Nonconvex World
- Sampled-Data Online Feedback Equilibrium Seeking: Stability and Tracking
- Stochastic Optimization for Performative Prediction
- Online Gradient Descent for Linear Dynamical Systems
- Data-driven stabilization of nonlinear polynomial systems with noisy data
- A Data-Driven Convex Programming Approach to Worst-Case Robust Tracking Controller Design