Population dynamics method with a multi-canonical feedback control

Abstract

We discuss the Giardinà-Kurchan-Peliti population dynamics method for evaluating large deviations of time averaged quantities in Markov processes [Phys. Rev. Lett. \textbf{96}, 120603 (2006)]. This method exhibits systematic errors which can be large in some circumstances, particularly for systems with weak noise, with many degrees of freedom, or close to dynamical phase transitions. We show how these errors can be mitigated by introducing control forces within the algorithm. These forces are determined by an iteration-and-feedback scheme, inspired by multicanonical methods in equilibrium sampling. We demonstrate substantially improved results in a simple model and we discuss potential applications to more complex systems.

18 pages, 9 figures

References in corpus (14)

• The large deviation approach to statistical mechanics
• Non equilibrium steady states: fluctuations and large deviations of the density and of the current
• Dynamic first-order phase transition in kinetically constrained models of glasses
• First-order dynamical phase transition in models of glasses: an approach based on ensembles of histories
• Adaptive Importance Sampling in General Mixture Classes
• A numerical approach to large deviations in continuous-time
• Genealogical particle analysis of rare events
• Random changes of flow topology in two dimensional and geophysical turbulence
• Equivalence and nonequivalence of ensembles: Thermodynamic, macrostate, and measure levels
• Probing rare physical trajectories with Lyapunov weighted dynamics
• Dynamic importance sampling for uniformly recurrent markov chains
• Current Fluctuations and Statistics During a Large Deviation Event in an Exactly-Solvable Transport Model
• Simulation of large deviation functions using population dynamics
• A sequential Monte Carlo approach to computing tail probabilities in stochastic models

Cited by in corpus (82)

• Simple bounds on fluctuations and uncertainty relations for first-passage times of counting observables
• Irreversibility and biased ensembles in active matter: Insights from stochastic thermodynamics
• Ergodicity and large deviations in physical systems with stochastic dynamics
• Optimizing active work: Dynamical phase transitions, collective motion, and jamming
• Finite-Size Scaling of a First-Order Dynamical Phase Transition: Adaptive Population Dynamics and an Effective Model
• Using matrix product states to study the dynamical large deviations of kinetically constrained models
• Phase separation and large deviations of lattice active matter
• Exact fluctuations of nonequilibrium steady states from approximate auxiliary dynamics
• Rare behavior of growth processes via umbrella sampling of trajectories
• How dissipation constrains fluctuations in nonequilibrium liquids: Diffusion, structure and biased interactions
• Dissipation controls transport and phase transitions in active fluids: Mobility, diffusion and biased ensembles
• Importance sampling large deviations in nonequilibrium steady states. I
• Effective driven dynamics for one-dimensional conditioned Langevin processes in the weak-noise limit
• A reinforcement learning approach to rare trajectory sampling
• Adaptive sampling of large deviations
• Physically consistent numerical solver for time-dependent Fokker-Planck equations
• Collective motion in large deviations of active particles
• Dynamical phase behavior of the single- and multi-lane asymmetric simple exclusion process via matrix product states
• Effective fluctuation and response theory
• Classical stochastic dynamics and continuous matrix product states: gauge transformations, conditioned and driven processes, and equivalence of trajectory ensembles
• Linking lineage and population observables in biological branching processes
• Order and symmetry-breaking in the fluctuations of driven systems
• Sampling rare events across dynamical phase transitions
• Universality in dynamical phase transitions of diffusive systems
• Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
• Learning nonequilibrium control forces to characterize dynamical phase transitions
• Reinforcement learning of rare diffusive dynamics
• Dynamical Phase Transitions in a 2D Classical Nonequilibrium Model via 2D Tensor Networks
• Finite-time and finite-size scalings in the evaluation of large-deviation functions: Analytical study using a birth-death process
• Controlled Sequential Monte Carlo
• Trajectory phase transitions in non-interacting spin systems
• Large deviations of random walks on random graphs
• Finite time large deviations via matrix product states
• Activity-induced phase transition in a quantum many-body system
• Phases of quantum dimers from ensembles of classical stochastic trajectories
• Optimal sampling of dynamical large deviations via matrix product states
• Direct evaluation of rare events in active matter from variational path sampling
• Variational design principles for nonequilibrium colloidal assembly
• Dynamical large deviations of two-dimensional kinetically constrained models using a neural-network state ansatz
• Optimal sampling of dynamical large deviations in two dimensions via tensor networks
• Finite-Time and -Size Scalings in the Evaluation of Large Deviation Functions: Numerical Approach in Continuous Time
• Efficient characterisation of large deviations using population dynamics
• Large deviations and optimal control forces for hard particles in one dimension
• Transport Coefficients from Large Deviation Functions
• Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain
• A large deviation theory perspective on nanoscale transport phenomena
• Large deviations in models of growing clusters with symmetry-breaking transitions
• Spin-orbit-coupled quantum memory of a double quantum dot
• A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations
• Thermodynamic Control of Activity Patterns in Cytoskeletal Networks
• Do extreme events trigger turbulence decay? - a numerical study of turbulence decay time in pipe flows
• A framework for the direct evaluation of large deviations in non-Markovian processes
• Work Fluctuations in the Active Ornstein- Uhlenbeck Particle model
• Spectral properties of the trap model on sparse networks
• Dynamical criticality in open systems: non-perturbative physics, microscopic origin and direct observation
• Data-driven methods to estimate the committor function in conceptual ocean models
• Variational deep learning of equilibrium transition path ensembles
• Biased ensembles of pulsating active matter
• Constructing Auxiliary Dynamics for Nonequilibrium Stationary States by Variance Minimization
• Modeling of biomolecular machines in non-equilibrium steady states
• Sampling rare fluctuations of discrete-time Markov chains
• Entropy Regularized Reinforcement Learning Using Large Deviation Theory
• Rare event simulation for stochastic dynamics in continuous time
• Approaching a large deviation theory for complex systems
• Finding the effective dynamics to make rare events typical in chaotic maps
• Finite-size and finite-time effects in large deviation functions near dynamical symmetry breaking transitions
• Limit theorems for cloning algorithms
• Adaptive power method for estimating large deviations in Markov chains
• Microphase separation in active filament systems is maintained by cyclic dynamics of cluster size and order
• The explicit form of the rate function for semi-Markov processes and its contractions
• Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control
• Dynamical phase transitions for the activity biased Ising model in a magnetic field
• Variational time reversal for free energy estimation in nonequilibrium steady states
• A self-similarity principle for the computation of rare event probability
• Stochastic formalism for thermally driven distribution frontier: A nonempirical approach to the potential escape problem
• Breakdown of the Finite-Time and -Population Scalings of the Large Deviation Function in the Large-Size Limit of a Contact Process
• Noise driven phase transitions in eco-evolutionary systems
• Mechanical analysis of a dynamical phase transition for particles in a channel
• Computing large deviation rate functions of entropy production for diffusion processes by an interacting particle method
• Density-dependent stochastic resetting: a large deviations framework for achieving target distributions over networks
• Making rare events typical in $d$-dimensional chaotic maps
• Steering Active-Colloid Assembly by Biasing Dissipation