Polynomial approximation of high-dimensional Hamilton-Jacobi-Bellman equations and applications to feedback control of semilinear parabolic PDEs

Abstract

A procedure for the numerical approximation of high-dimensional Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control problems for semilinear parabolic equations is proposed. Its main ingredients are a pseudospectral collocation approximation of the PDE dynamics, and an iterative method for the nonlinear HJB equation associated to the feedback synthesis. The latter is known as the Successive Galerkin Approximation. It can also be interpreted as Newton iteration for the HJB equation. At every step, the associated linear Generalized HJB equation is approximated via a separable polynomial approximation ansatz. Stabilizing feedback controls are obtained from solutions to the HJB equations for systems of dimension up to fourteen.

Cited by in corpus (13)

• Adaptive Deep Learning for High-Dimensional Hamilton-Jacobi-Bellman Equations
• On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
• Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networks
• QRnet: optimal regulator design with LQR-augmented neural networks
• A new scalable algorithm for computational optimal control under uncertainty
• Neural network architectures using min-plus algebra for solving certain high dimensional optimal control problems and Hamilton-Jacobi PDEs
• Neural Network Optimal Feedback Control with Guaranteed Local Stability
• Deep neural network approximations for the stable manifolds of the Hamilton-Jacobi-Bellman equations
• Neural network optimal feedback control with enhanced closed loop stability
• HJB-RBF based approach for the control of PDEs
• Neural Network Approximation of Optimal Controls for Stochastic Reaction-Diffusion Equations
• Approximation of Optimal Control Surfaces for $2\times 2$ Skew-Symmetric Evolutionary Game Dynamics
• Approximation of Optimal Feedback Controls for Stochastic Reaction-Diffusion Equations