Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimation

Abstract

Fokker-Planck equations are extensively employed in various scientific fields as they characterise the behaviour of stochastic systems at the level of probability density functions. Although broadly used, they allow for analytical treatment only in limited settings, and often is inevitable to resort to numerical solutions. Here, we develop a computational approach for simulating the time evolution of Fokker-Planck solutions in terms of a mean field limit of an interacting particle system. The interactions between particles are determined by the gradient of the logarithm of the particle density, approximated here by a novel statistical estimator. The performance of our method shows promising results, with more accurate and less fluctuating statistics compared to direct stochastic simulations of comparable particle number. Taken together, our framework allows for effortless and reliable particle-based simulations of Fokker-Planck equations in low and moderate dimensions. The proposed gradient-log-density estimator is also of independent interest, for example, in the context of optimal control.

arXiv comment34 pages, 8 figures

References in corpus (14)

• Approximation and inference methods for stochastic biochemical kinetics - a tutorial review
• Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm
• Stein Variational Gradient Descent as Gradient Flow
• Extrinsic noise driven phenotype switching in a self-regulating gene
• Gradient Estimators for Implicit Models
• Efficient Statistically Accurate Algorithms for the Fokker-Planck Equation in Large Dimensions
• A Spectral Approach to Gradient Estimation for Implicit Distributions
• Stein Variational Gradient Descent With Matrix-Valued Kernels
• Deep Energy Estimator Networks
• How to solve Fokker-Planck equation treating mixed eigenvalue spectrum?
• Approximate inference with Wasserstein gradient flows
• Variational estimation of the drift for stochastic differential equations from the empirical density
• Accelerated Flow for Probability Distributions
• Efficient and principled score estimation with Nyström kernel exponential families

Cited by in corpus (12)

• Score-Based Generative Modeling through Stochastic Differential Equations
• Maximum Likelihood Training of Score-Based Diffusion Models
• Diffusion Models as Stochastic Quantization in Lattice Field Theory
• Neural Parametric Fokker-Planck Equations
• pop-cosmos: A comprehensive picture of the galaxy population from COSMOS data
• pop-cosmos: Scaleable inference of galaxy properties and redshifts with a data-driven population model
• Information Newton's flow: second-order optimization method in probability space
• Ensemble Variational Fokker-Planck Methods for Data Assimilation
• An Exact Theory of Causal Emergence for Linear Stochastic Iteration Systems
• Deterministic particle flows for constraining SDEs
• On the numerical integration of the Fokker-Planck equation driven by a mechanical force and the Bismut-Elworthy-Li formula
• Deterministic particle flows for constraining stochastic nonlinear systems