5 papers
A Fully Data-Driven Value Iteration for Stochastic LQR: Convergence, Robustness and Stability
Leilei Cui, Zhong-Ping Jiang, Petter N. Kolm +1
Unlike traditional model-based reinforcement learning approaches that estimate system parameters from data, non-model-based data-driven control learns the optimal policy directly f…
LQR for Systems with Probabilistic Parametric Uncertainties: A Gradient Method
Leilei Cui, Richard D. Braatz
A gradient-based method is proposed for solving the linear quadratic regulator (LQR) problem for linear systems with nonlinear dependence on time-invariant probabilistic parametric…
Small-Covariance Noise-to-State Stability of Stochastic Systems and Its Applications to Stochastic Gradient Dynamics
Leilei Cui, Zhong-Ping Jiang, Eduardo D. Sontag
This paper studies gradient dynamics subject to additive random noise, which may arise from sources such as stochastic gradient estimation, measurement noise, or stochastic samplin…
Perturbed Gradient Descent Algorithms are Small-Disturbance Input-to-State Stable
Leilei Cui, Zhong-Ping Jiang, Eduardo D. Sontag +1
This article investigates the robustness of gradient descent algorithms under perturbations. The concept of small-disturbance input-to-state stability (ISS) for discrete-time nonli…
Remarks on the Polyak-Lojasiewicz inequality and the convergence of gradient systems
Arthur Castello B. de Oliveira, Leilei Cui, Eduardo D. Sontag
This work explores generalizations of the Polyak-Lojasiewicz inequality (PLI) and their implications for the convergence behavior of gradient flows in optimization problems. Motiva…