On the numerical integration of the Fokker-Planck equation driven by a mechanical force and the Bismut-Elworthy-Li formula
arXiv:2411.08518 · doi:10.3390/e27030218
Abstract
Optimal control theory aims to find an optimal protocol to steer a system between assigned boundary conditions while minimizing a given cost functional in finite time. Equations arising from these types of problems are often non-linear and difficult to solve numerically. In this note, we describe numerical methods of integration for two partial differential equations that commonly arise in optimal control theory: the Fokker-Planck equation driven by a mechanical potential for which we use Girsanov theorem; and the Hamilton-Jacobi-Bellman, or dynamic programming, equation for which we find the gradient of its solution using the Bismut-Elworthy-Li formula. The computation of the gradient is necessary to specify the optimal protocol. Finally, we give an example application of the numerical techniques to solving an optimal control problem without spacial discretization using machine learning.
31 pages, 6 figures
References in corpus (14)
- Efficiency at maximum power: An analytically solvable model for stochastic heat engines
- Finite-time Landauer principle
- Irreversibility and biased ensembles in active matter: Insights from stochastic thermodynamics
- Fluctuation Relations for Diffusion Processes
- Efficiency of molecular motors at maximum power
- Diffusion Schrödinger Bridge with Applications to Score-Based Generative Modeling
- Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimation
- Interference of Quantum Trajectories
- Solving Schrödinger Bridges via Maximum Likelihood
- On how nanomechanical systems can minimize dissipation
- E. Schrödinger's 1931 paper "On the Reversal of the Laws of Nature" ["Über die Umkehrung der Naturgesetze",Sitzungsberichte der preussischen Akademie der Wissenschaften, physikalische mathematische Klasse, 8 N9 144-153]
- Theoretical guarantees for sampling and inference in generative models with latent diffusions
- Optimal Control of Underdamped Systems: An Analytic Approach
- Improving control based importance sampling strategies for metastable diffusions via adapted metadynamics