Estimating entropy production by machine learning of short-time fluctuating currents

Abstract

Thermodynamic uncertainty relations (TURs) are the inequalities which give lower bounds on the entropy production rate using only the mean and the variance of fluctuating currents. Since the TURs do not refer to the full details of the stochastic dynamics, it would be promising to apply the TURs for estimating the entropy production rate from a limited set of trajectory data corresponding to the dynamics. Here we investigate a theoretical framework for estimation of the entropy production rate using the TURs along with machine learning techniques without prior knowledge of the parameters of the stochastic dynamics. Specifically, we derive a TUR for the short-time region and prove that it can provide the exact value, not only a lower bound, of the entropy production rate for Langevin dynamics, if the observed current is optimally chosen. This formulation naturally includes a generalization of the TURs with the partial entropy production of subsystems under autonomous interaction, which reveals the hierarchical structure of the estimation. We then construct estimators on the basis of the short-time TUR and machine learning techniques such as the gradient ascent. By performing numerical experiments, we demonstrate that our learning protocol performs well even in nonlinear Langevin dynamics. We also discuss the case of Markov jump processes, where the exact estimation is shown to be impossible in general. Our result provides a platform that can be applied to a broad class of stochastic dynamics out of equilibrium, including biological systems.

References in corpus (52)

• A nonequilibrium equality for free energy differences
• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
• Thermodynamic uncertainty relation for biomolecular processes
• Information heat engine: converting information to energy by feedback control
• Steady State Thermodynamics of Langevin Systems
• Dissipation bounds all steady-state current fluctuations
• Generalized Jarzynski Equality under Nonequilibrium Feedback Control
• Brownian Carnot engine
• Three detailed fluctuation theorems
• Universal trade-off between power, efficiency, and constancy in steady-state heat engines
• Single-molecule experiments in biological physics: methods and applications
• Universal trade-off relation between power and efficiency for heat engines
• Proof of the Finite-Time Thermodynamic Uncertainty Relation for Steady-State Currents
• Fluctuation Theorem with Information Exchange: Role of Correlations in Stochastic Thermodynamics
• Estimating dissipation from single stationary trajectories
• Thermodynamics with continuous information flow
• Fluctuation theorem uncertainty relation
• Finite-time generalization of the thermodynamic uncertainty relation
• Thermodynamic uncertainty relations from exchange fluctuation theorems
• Quantifying dissipation using fluctuating currents
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
• Current fluctuations and transport efficiency for general Langevin systems
• Discrete-time thermodynamic uncertainty relation
• Thermodynamics of precision in quantum non equilibrium steady states
• Generic Properties of Stochastic Entropy Production
• Information Thermodynamics on Causal Networks
• Universal bound on the efficiency of molecular motors
• Maxwell's demon in biochemical signal transduction with feedback loop
• Inferring dissipation from current fluctuations
• Inferring entropy production from short experiments
• Multidimensional thermodynamic uncertainty relations
• Entropy production in full phase space for continuous stochastic dynamics
• Fluctuation Theorem for Partially-masked Nonequilibrium Dynamics
• Uncertainty relations in stochastic processes: An information inequality approach
• Inferring broken detailed balance in the absence of observable currents
• Stochastic thermodynamic interpretation of information geometry
• Kinetic uncertainty relation
• Entropy production estimation with optimal current
• Thermodynamic uncertainty relations including measurement and feedback
• Bounds on current fluctuations in periodically driven systems
• Thermodynamic efficiency of information and heat flow
• Entropic bounds on currents in Langevin systems
• Learning force fields from stochastic trajectories
• Uncertainty relations for underdamped Langevin dynamics
• Entropy Production Rate is Maximized in Non-Contractile Actomyosin
• Hyperaccurate currents in stochastic thermodynamics
• Thermodynamic uncertainty relation for underdamped Langevin systems driven by a velocity-dependent force
• Noninvasive Measurement of Dissipation in Colloidal Systems
• Uncertainty relation under information measurement and feedback control
• Continuous information flow fluctuations
• Exact results for the finite time thermodynamic uncertainty relation

Cited by in corpus (84)

• Thermodynamic Unification of Optimal Transport: Thermodynamic Uncertainty Relation, Minimum Dissipation, and Thermodynamic Speed Limits
• Inferring entropy production from short experiments
• Unified Approach to Classical Speed Limit and Thermodynamic Uncertainty Relation
• Thermodynamic uncertainty relation for general open quantum systems
• Thermodynamics of Precision in Markovian Open Quantum Dynamics
• Geometrical aspects of entropy production in stochastic thermodynamics based on Wasserstein distance
• Unified thermodynamic-kinetic uncertainty relation
• Improving thermodynamic bounds using correlations
• Unifying speed limit, thermodynamic uncertainty relation and Heisenberg principle via bulk-boundary correspondence
• Thermodynamic Bound on the Asymmetry of Cross-Correlations
• Thermodynamic uncertainty relation and thermodynamic speed limit in deterministic chemical reaction networks
• Learning entropy production via neural networks
• Direct Route to Thermodynamic Uncertainty Relations and Their Saturation
• Thermodynamic uncertainty relation for systems with unidirectional transitions
• Estimating time-dependent entropy production from non-equilibrium trajectories
• Speed Limits for Macroscopic Transitions
• Distribution of the time of the maximum for stationary processes
• Optimal thermodynamic uncertainty relation in Markov jump processes
• Housekeeping and excess entropy production for general nonlinear dynamics
• Geometric thermodynamics for the Fokker-Planck equation: Stochastic thermodynamic links between information geometry and optimal transport
• Milestoning estimators of dissipation in systems observed at a coarse resolution: When ignorance is truly bliss
• Coarse-grained entropy production with multiple reservoirs: unraveling the role of time-scales and detailed balance in biology-inspired systems
• Quantitative analysis of non-equilibrium systems from short-time experimental data
• Tightest bound on hidden entropy production from partially observed dynamics
• Inference in non-equilibrium systems from incomplete information: the case of linear systems and its pitfalls
• Information Geometric Inequalities of Chemical Thermodynamics
• Geometric decomposition of entropy production into excess, housekeeping and coupling parts
• Deep learning probability flows and entropy production rates in active matter
• Mathematical, Thermodynamical, and Experimental Necessity for Coarse Graining Empirical Densities and Currents in Continuous Space
• Fundamental bounds on precision and response for quantum trajectory observables
• Effect of Measurement Backaction on Quantum Clock Precision Studied with a Superconducting Circuit
• Heat fluctuations in a harmonic chain of active particles
• Coarse Graining Empirical Densities and Currents in Continuous-Space Steady States
• Irreversibility, Loschmidt echo, and thermodynamic uncertainty relation
• Fluctuations of entropy production of a run-and-tumble particle
• Thermodynamic uncertainty relation for quantum first passage process
• Thermodynamic Uncertainty Relation in Interacting Many-Body Systems
• Dissipation, quantum coherence, and asymmetry of finite-time cross-correlations
• Enhanced directionality of active processes in a viscoelastic bath
• Universal bounds on the performance of information-thermodynamic engine
• A thermodynamic uncertainty relation for a system with memory
• Flow of Energy and Information in Molecular Machines
• Dynamical activity universally bounds precision of response in Markovian nonequilibrium systems
• Effective estimation of entropy production with lacking data
• Inferring entropy production in anharmonic Brownian gyrators
• Thermodynamic Uncertainty Relations for Steady-State Thermodynamics
• Thermodynamic bounds on generalized transport: From single-molecule to bulk observables
• Higher-order Efficiency Bound and Its Application to Nonlinear Nano-thermoelectrics
• Thermodynamic correlation inequality
• Hyperaccurate bounds in discrete-state Markovian systems
• Conceptual and practical approaches for investigating irreversible processes
• Estimating entropy production in a stochastic system with odd-parity variables
• Variance sum rule: proofs and solvable models
• Quality of the Thermodynamic Uncertainty Relation for Fast and Slow Driving
• Thermodynamic uncertainty relations in the presence of non-linear friction and memory
• Experimental verification of Arcsine laws in mesoscopic non-equilibrium and active systems
• Two applications of stochastic thermodynamics to hydrodynamics
• Estimate of entropy generation rate can spatiotemporally resolve the active nature of cell flickering
• Inferring entropy production from time-dependent moments
• Jensen bound for the entropy production rate in stochastic thermodynamics
• Geometric thermodynamics of reaction-diffusion systems: Thermodynamic trade-off relations and optimal transport for pattern formation
• Decomposing Thermodynamic Dissipation of Linear Langevin Systems via Oscillatory Modes and Its Application to Neural Dynamics
• Infinite variety of thermodynamic speed limits with general activities
• Force-current structure in Markovian open quantum systems and its applications: geometric housekeeping-excess decomposition and thermodynamic trade-off relations
• Improved estimation for energy dissipation in biochemical oscillations
• Continuous time-reversal and equality in the thermodynamic uncertainty relation
• Speed-accuracy relations for diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport
• Inferring entropy production in many-body systems using nonequilibrium maximum entropy
• Measurement of irreversibility and entropy production via the tubular ensemble
• Attaining entropy production and dissipation maps from Brownian movies via neural networks
• Inferring nonequilibrium thermodynamics from tilted equilibrium using information-geometric Legendre transform
• Improving estimation of entropy production rate for run-and-tumble particle systems by high-order thermodynamic uncertainty relation
• Force-free kinetic inference of entropy production
• Generalized free energy and excess/housekeeping decomposition in nonequilibrium systems: from large deviations to thermodynamic speed limits
• Inverse thermodynamic uncertainty relation and entropy production
• Stochastic Thermodynamics of Non-reciprocally Interacting Particles and Fields
• Quasiprobability Thermodynamic Uncertainty Relation
• Compensating random transition-detection blackouts in Markov networks
• Violation of the thermodynamic uncertainty relation in quantum collisional models
• Irreversibility of mesoscopic processes with hydrodynamic interactions
• Lower Bound on Irreversibility in Thermal Relaxation of Open Quantum Systems
• Thermodynamic uncertainty relation in the overdamped limit with a magnetic Lorentz force
• Thermodynamic speed limit for non-adiabatic work and its classical-quantum decomposition
• Time-cost-error trade-off relation in thermodynamics: The third law and beyond