Learning nonequilibrium control forces to characterize dynamical phase transitions

Abstract

Sampling the collective, dynamical fluctuations that lead to nonequilibrium pattern formation requires probing rare regions of trajectory space. Recent approaches to this problem based on importance sampling, cloning, and spectral approximations, have yielded significant insight into nonequilibrium systems, but tend to scale poorly with the size of the system, especially near dynamical phase transitions. Here we propose a machine learning algorithm that samples rare trajectories and estimates the associated large deviation functions using a many-body control force by leveraging the flexible function representation provided by deep neural networks, importance sampling in trajectory space, and stochastic optimal control theory. We show that this approach scales to hundreds of interacting particles and remains robust at dynamical phase transitions.

arXiv comment11 pages, 5 figures. v2: corrected version, close to published version

References in corpus (51)

• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
• The large deviation approach to statistical mechanics
• Motility-Induced Phase Separation
• Reconciling modern machine learning practice and the bias-variance trade-off
• A Gallavotti-Cohen Type Symmetry in the Large Deviation Functional for Stochastic Dynamics
• Non equilibrium steady states: fluctuations and large deviations of the density and of the current
• Dissipation bounds all steady-state current fluctuations
• Macroscopic fluctuation theory
• Dynamics on the Way to Forming Glass: Bubbles in Space-time
• A Mean Field View of the Landscape of Two-Layers Neural Networks
• Dynamic first-order phase transition in kinetically constrained models of glasses
• Fluctuation theorems for stochastic dynamics
• Exact Large Deviation Function in the Asymmetric Exclusion Process
• Direct evaluation of large-deviation functions
• Nonequilibrium Markov processes conditioned on large deviations
• Effective Cahn-Hilliard equation for the phase separation of active Brownian particles
• Universal bounds on current fluctuations
• Space-time Thermodynamics of the Glass Transition
• Stochastic interacting particle systems out of equilibrium
• Introduction to dynamical large deviations of Markov processes
• Power and heat fluctuation theorems for electric circuits
• A numerical approach to large deviations in continuous-time
• Irreversibility and biased ensembles in active matter: Insights from stochastic thermodynamics
• Variational and optimal control representations of conditioned and driven processes
• Fluctuations in out of equilibrium systems: from theory to experiment
• Population dynamics method with a multi-canonical feedback control
• Effective interactions and large deviations in stochastic processes
• Design principles for non-equilibrium self-assembly
• Current large deviations for Asymmetric Exclusion Processes with open boundaries
• Go with the Winners: a General Monte Carlo Strategy
• Large fluctuations and dynamic phase transition in a system of self-propelled particles
• Phase separation and large deviations of lattice active matter
• Exact fluctuations of nonequilibrium steady states from approximate auxiliary dynamics
• Entropy production fluctuations encode collective behavior in active matter
• How dissipation constrains fluctuations in nonequilibrium liquids: Diffusion, structure and biased interactions
• Dissipation controls transport and phase transitions in active fluids: Mobility, diffusion and biased ensembles
• A reinforcement learning approach to rare trajectory sampling
• Adaptive sampling of large deviations
• Large deviation function for the entropy production: Optimal trajectory and role of fluctuations
• Collective motion in large deviations of active particles
• Current fluctuations of interacting active Brownian particles
• Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
• Extreme fluctuations of active Brownian motion
• Reinforcement learning of rare diffusive dynamics
• Evolutionary reinforcement learning of dynamical large deviations
• Dynamical large deviations of two-dimensional kinetically constrained models using a neural-network state ansatz
• A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations
• Dispersion for Two Classes of Random Variables: General Theory and Application to Inference of an External Ligand Concentration by a Cell
• Constructing Auxiliary Dynamics for Nonequilibrium Stationary States by Variance Minimization
• Exact Large Deviations of the Current in the Asymmetric Simple Exclusion Process with Open Boundaries

Cited by in corpus (22)

• Classical Nucleation Theory for Active Fluid Phase Separation
• Dynamical large deviations of linear diffusions
• Limited-control optimal protocols arbitrarily far from equilibrium
• Finite time large deviations via matrix product states
• Entropy production and its large deviations in an active lattice gas
• Landau theory for finite-time dynamical phase transitions
• Variational deep learning of equilibrium transition path ensembles
• Modeling of biomolecular machines in non-equilibrium steady states
• Biased ensembles of pulsating active matter
• Spectral signatures of symmetry-breaking dynamical phase transitions
• Finding the effective dynamics to make rare events typical in chaotic maps
• Computing non-equilibrium trajectories by a deep learning approach
• Convergence of the Integral Fluctuation Theorem estimator for nonequilibrium Markov systems
• An introduction to large deviations with applications in physics
• Adaptive power method for estimating large deviations in Markov chains
• Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control
• Variational time reversal for free energy estimation in nonequilibrium steady states
• Role of interactions in non-equilibrium transformations
• Understanding random-walk dynamical phase coexistence through waiting times
• Towards neural reinforcement learning for large deviations in nonequilibrium systems with memory
• Mechanical analysis of a dynamical phase transition for particles in a channel
• Global thermodynamic manifold for conservative control of stochastic systems