4 papers
Decision Transformer as a Foundation Model for Partially Observable Continuous Control
Xiangyuan Zhang, Weichao Mao, Haoran Qiu +1
Closed-loop control of nonlinear dynamical systems with partial-state observability demands expert knowledge of a diverse, less standardized set of theoretical tools. Moreover, it…
Policy Optimization for PDE Control with a Warm Start
Xiangyuan Zhang, Saviz Mowlavi, Mouhacine Benosman +1
Dimensionality reduction is crucial for controlling nonlinear partial differential equations (PDE) through a "reduce-then-design" strategy, which identifies a reduced-order model a…
Global Convergence of Receding-Horizon Policy Search in Learning Estimator Designs
Xiangyuan Zhang, Saviz Mowlavi, Mouhacine Benosman +1
We introduce the receding-horizon policy gradient (RHPG) algorithm, the first PG algorithm with provable global convergence in learning the optimal linear estimator designs, i.e.,…
Learning the Kalman Filter with Fine-Grained Sample Complexity
Xiangyuan Zhang, Bin Hu, Tamer Başar
We develop the first end-to-end sample complexity of model-free policy gradient (PG) methods in discrete-time infinite-horizon Kalman filtering. Specifically, we introduce the rece…