Mean-Field Optimal Control

Abstract

We introduce the concept of {\it mean-field optimal control} which is the rigorous limit process connecting finite dimensional optimal control problems with ODE constraints modeling multi-agent interactions to an infinite dimensional optimal control problem with a constraint given by a PDE of Vlasov-type, governing the dynamics of the probability distribution of interacting agents. While in the classical mean-field theory one studies the behavior of a large number of small individuals {\it freely interacting} with each other, by simplifying the effect of all the other individuals on any given individual by a single averaged effect, we address the situation where the individuals are actually influenced also by an external {\it policy maker}, and we propagate its effect for the number $N$ of individuals going to infinity. On the one hand, from a modeling point of view, we take into account also that the policy maker is constrained to act according to optimal strategies promoting its most parsimonious interaction with the group of individuals. This will be realized by considering cost functionals including $L^1$-norm terms penalizing a broadly distributed control of the group, while promoting its sparsity. On the other hand, from the analysis point of view, and for the sake of generality, we consider broader classes of convex control penalizations. In order to develop this new concept of limit rigorously, we need to carefully combine the classical concept of mean-field limit, connecting the finite dimensional system of ODE describing the dynamics of each individual of the group to the PDE describing the dynamics of the respective probability distribution, with the well-known concept of $\Gamma$-convergence to show that optimal strategies for the finite dimensional problems converge to optimal strategies of the infinite dimensional problem.

31 pages

References in corpus (4)

• Novel type of phase transition in a system of self-driven particles
• Interaction Ruling Animal Collective Behaviour Depends on Topological rather than Metric Distance: Evidence from a Field Study
• State Transitions and the Continuum Limit for a 2D Interacting, Self-Propelled Particle System
• The derivation of Swarming models: Mean-Field Limit and Wasserstein distances

Cited by in corpus (29)

• Invisible control of self-organizing agents leaving unknown environments
• Mean-Field Sparse Optimal Control
• A Mean-Field Optimal Control Formulation of Deep Learning
• Instantaneous control of interacting particle systems in the mean-field limit
• Optimal consensus control of the Cucker-Smale model
• The Pontryagin Maximum Principle in the Wasserstein Space
• Differential Inclusions in Wasserstein Spaces: The Cauchy-Lipschitz Framework
• A Pontryagin Maximum Principle in Wasserstein Spaces for Constrained Optimal Control Problems
• Optimal Feedback Law Recovery by Gradient-Augmented Sparse Polynomial Regression
• Mathematical models and methods for crowd dynamics control
• Adjoint DSMC for nonlinear Boltzmann equation constrained optimization
• Approximate and exact controllability of the continuity equation with a localized vector field
• Minimal time for the continuity equation controlled by a localized perturbation of the velocity vector field
• Semiconcavity and Sensitivity Analysis in Mean-Field Optimal Control and Applications
• $1$-dimensional multi-agent optimal control with aggregation and distance constraints: qualitative properties and mean-field limit
• Mean-field limit of a hybrid system for multi-lane multi-class traffic
• Leader-Follower Density Control of Spatial Dynamics in Large-Scale Multi-Agent Systems
• Learning Swarm Interaction Dynamics from Density Evolution
• Natural Actor-Critic Converges Globally for Hierarchical Linear Quadratic Regulator
• The turnpike property for mean-field optimal control problems
• Vanishing viscosity in mean-field optimal control
• Meanfield games and model predictive control
• Carathéodory Theory and A Priori Estimates for Continuity Inclusions in the Space of Probability Measures
• PDE-Constrained Optimization Models and Pseudospectral Methods for Multiscale Particle Dynamics
• PDE-constrained optimal control of a leader-follower opinion formation model
• A Pontryagin Maximum Principle for agent-based models with convex state space
• Linear quadratic mean field social optimization: Asymptotic solvability and decentralized control
• Mean-field and kinetic limit of affine control systems: optimal control through leaders
• Exponential turnpike property for particle systems and mean-field limit