Deep learning probability flows and entropy production rates in active matter

Abstract

Active matter systems, from self-propelled colloids to motile bacteria, are characterized by the conversion of free energy into useful work at the microscopic scale. They involve physics beyond the reach of equilibrium statistical mechanics, and a persistent challenge has been to understand the nature of their nonequilibrium states. The entropy production rate and the probability current provide quantitative ways to do so by measuring the breakdown of time-reversal symmetry. Yet, their efficient computation has remained elusive, as they depend on the system's unknown and high-dimensional probability density. Here, building upon recent advances in generative modeling, we develop a deep learning framework to estimate the score of this density. We show that the score, together with the microscopic equations of motion, gives access to the entropy production rate, the probability current, and their decomposition into local contributions from individual particles. To represent the score, we introduce a novel, spatially-local transformer network architecture that learns high-order interactions between particles while respecting their underlying permutation symmetry. We demonstrate the broad utility and scalability of the method by applying it to several high-dimensional systems of active particles undergoing motility-induced phase separation (MIPS). We show that a single network trained on a system of 4096 particles at one packing fraction can generalize to other regions of the phase diagram, including systems with as many as 32768 particles. We use this observation to quantify the spatial structure of the departure from equilibrium in MIPS as a function of the number of particles and the packing fraction.

References in corpus (52)

• Novel type of phase transition in a system of self-driven particles
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• Machine Learning for Fluid Mechanics
• The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
• Machine learning and the physical sciences
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Motility-Induced Phase Separation
• Entropy production along a stochastic trajectory and an integral fluctuation theorem
• Deep learning for universal linear embeddings of nonlinear dynamics
• A Gallavotti-Cohen Type Symmetry in the Large Deviation Functional for Stochastic Dynamics
• Macroscopic fluctuation theory
• How far from equilibrium is active matter?
• Learning data driven discretizations for partial differential equations
• Deep neural network solution of the electronic Schrödinger equation
• Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
• Elucidating the Design Space of Diffusion-Based Generative Models
• A self-propelled particle in an external potential: is there an effective temperature?
• Statistical Mechanics of Active Ornstein Uhlenbeck Particles
• OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features
• Entropy production and the arrow of time
• Irreversibility in active matter systems: Fluctuation theorem and mutual information
• Path-integral analysis of fluctuation theorems for general Langevin processes
• Quantifying dissipation using fluctuating currents
• Solving parametric PDE problems with artificial neural networks
• Refined Second Law of Thermodynamics for fast random processes
• Generic Properties of Stochastic Entropy Production
• Entropy production and fluctuation theorems for active matter
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Hidden entropy production and work fluctuations in an ideal active gas
• Irreversibility and biased ensembles in active matter: Insights from stochastic thermodynamics
• Entropy production of active particles and for particles in active baths
• Fluctuation Relations for Diffusion Processes
• Estimating entropy production by machine learning of short-time fluctuating currents
• Time-(ir)reversibility in active matter: from micro to macro
• The nonequilibrium glassy dynamics of self-propelled particles
• Cumulants and large deviations of the current through non-equilibrium steady states
• The Entropy Production of Ornstein-Uhlenbeck Active Particles: a path integral method for correlations
• Heat, temperature and Clausius inequality in a model for active brownian particles
• Quantifying hidden order out of equilibrium
• Learning hydrodynamic equations for active matter from particle simulations and experiments
• Origins and diagnostics of the nonequilibrium character of active systems
• Play. Pause. Rewind. Measuring local entropy production and extractable work in active matter
• The "footprints'' of irreversibility
• Clausius relation for active particles: what can we learn from fluctuations?
• Estimating time-dependent entropy production from non-equilibrium trajectories
• Active Brownian particles driven by constant affinity
• Critical Phenomena in Active Matter
• Comment on "Entropy Production and Fluctuation Theorems for Active Matter"
• Time-reversal symmetry violations and entropy production in field theories of polar active matter
• A unified, geometric framework for nonequilibrium protocol optimization
• Deep learning probability flows and entropy production rates in active matter

Cited by in corpus (5)

• Deep learning probability flows and entropy production rates in active matter
• Variational time reversal for free energy estimation in nonequilibrium steady states
• Inferring entropy production in many-body systems using nonequilibrium maximum entropy
• Inferring activity from the flow field around active colloidal particles using deep learning
• Effective Energy, Interactions And Out Of Equilibrium Nature Of Scalar Active Matter