Schrödinger Approach to Optimal Control of Large-Size Populations
arXiv:1810.06064 · doi:10.1109/TAC.2020.3007543
Abstract
Large-size populations consisting of a continuum of identical and non-cooperative agents with stochastic dynamics are useful in modeling various biological and engineered systems. This paper addresses the stochastic control problem of designing optimal state-feedback controllers which guarantee the closed-loop stability of the stationary density of such agents with nonlinear Langevin dynamics, under the action of their individual steady state controls. We represent the corresponding coupled forward-backward PDEs as decoupled Schrödinger equations, by applying two variable transforms. Spectral properties of the linear Schrödinger operator which underlie the stability analysis are used to obtain explicit control design constraints. Our interpretation of the Schrödinger potential as the cost function of a closely related optimal control problem motivates a quadrature based algorithm to compute the finite-time optimal control.
arXiv comment21 pages, 2 figures
References in corpus (9)
- Synchronization and Power Sharing for Droop-Controlled Inverters in Islanded Microgrids
- Path integrals and symmetry breaking for optimal control theory
- A linear theory for control of non-linear stochastic systems
- Electrical Vehicles in the Smart Grid: A Mean Field Game Analysis
- Numerical Integration in Multiple Dimensions with Designed Quadrature
- An [imaginary time] Schrödinger approach to mean field games
- A discrete Schrodinger equation via optimal transport on graphs
- A mean-field game model for homogeneous flocking
- Mean-field Games for Bio-inspired Collective Decision-making in Dynamical Networks