Inference in non-equilibrium systems from incomplete information: the case of linear systems and its pitfalls

Abstract

Data from experiments and theoretical arguments are the two pillars sustaining the job of modelling physical systems through inference. In order to solve the inference problem, the data should satisfy certain conditions that depend also upon the particular questions addressed in a research. Here we focus on the characterization of systems in terms of a distance from equilibrium, typically the entropy production (time-reversal asymmetry) or the violation of the Kubo fluctuation-dissipation relation. We show how general, counter-intuitive and negative for inference, is the problem of the impossibility to estimate the distance from equilibrium using a series of scalar data which have a Gaussian statistics. This impossibility occurs also when the data are correlated in time, and that is the most interesting case because it usually stems from a multi-dimensional linear Markovian system where there are many time-scales associated to different variables and, possibly, thermal baths. Observing a single variable (or a linear combination of variables) results in a one-dimensional process which is always indistinguishable from an equilibrium one (unless a perturbation-response experiment is available). In a setting where only data analysis (and not new experiments) is allowed, we propose - as a way out - the combined use of different series of data acquired with different parameters. This strategy works when there is a sufficient knowledge of the connection between experimental parameters and model parameters. We also briefly discuss how such results emerge, similarly, in the context of Markov chains within certain coarse-graining schemes. Our conclusion is that the distance from equilibrium is related to quite a fine knowledge of the full phase space, and therefore typically hard to approximate in real experiments.

arXiv comment23 pages - 8 figures

References in corpus (56)

• Measuring Information Transfer
• A Gallavotti-Cohen Type Symmetry in the Large Deviation Functional for Stochastic Dynamics
• Crackling Noise
• Granger causality and transfer entropy are equivalent for Gaussian variables
• Thermodynamic uncertainty relation for biomolecular processes
• Fluctuation-Dissipation: Response Theory in Statistical Physics
• Dissipation bounds all steady-state current fluctuations
• Dissipation: The phase-space perspective
• Dimensionality and dynamics in the behavior of C. elegans
• Equality connecting energy dissipation with violation of fluctuation-response relation
• Nonequilibrium Markov processes conditioned on large deviations
• Broken detailed balance and non-equilibrium dynamics in living systems
• Quantifying dissipation using fluctuating currents
• Entropy production and time asymmetry in nonequilibrium fluctuations
• On the heat flux and entropy produced by thermal fluctuations
• Inferring entropy production from short experiments
• Inferring broken detailed balance in the absence of observable currents
• The Brownian gyrator: a minimal heat engine on the nano-scale
• Estimating entropy production by machine learning of short-time fluctuating currents
• Chaos or Noise - Difficulties of a Distinction
• Kinetic uncertainty relation
• Non-equilibrium and information: the role of cross-correlations
• Fluctuation theorem for non-equilibrium relaxational systems driven by external forces
• Improved bounds on entropy production in living systems
• Universal Pulse Shape Scaling Function and Exponents: A Critical Test for Avalanche Models applied to Barkhausen Noise
• Estimating entropy production from waiting time distributions
• Human sperm steer with second harmonics of the flagellar beat
• From the area under the Bessel excursion to anomalous diffusion of cold atoms
• Experimental Realization of a Minimal Microscopic Heat Engine
• Universal mean moment rate profiles of earthquake ruptures
• Multiple-scale stochastic processes: decimation, averaging and beyond
• Effective thermodynamics for a marginal observer
• Local and global avalanches in a 2D sheared granular medium
• Entropy production and coarse-graining in Markov processes
• Broken Detailed Balance of Filament Dynamics in Active Networks
• Frenetic bounds on the entropy production
• Validity of time reversal for testing Granger causality
• Statistical properties of the energy exchanged between two heat baths coupled by thermal fluctuations
• Emergent memory and kinetic hysteresis in strongly driven networks
• Decomposing the local arrow of time in interacting systems
• Exact Coarse Graining Preserves Entropy Production out of Equilibrium
• What do we mean by the dimensionality of behavior?
• Learning entropy production via neural networks
• Coarse graining of master equations with fast and slow states
• Hyperaccurate currents in stochastic thermodynamics
• Distribution of the time of the maximum for stationary processes
• Fluctuation preserving coarse graining for biochemical systems
• Understanding causation via correlations and linear response theory
• Fluctuations of global energy release and crackling in nominally brittle heterogeneous fracture
• Asymmetric damage avalanche shape in quasi-brittle materials and sub-avalanches (aftershocks) clusters
• Building general Langevin models from discrete data sets
• Exit-Times and {\Large $\epsilon$}-Entropy for Dynamical Systems, Stochastic Processes, and Turbulence
• Synergy as a warning sign of transitions: the case of the two-dimensional Ising model
• The Role of Data in Model Building and Prediction: A Survey Through Examples
• Spectral fingerprints of non-equilibrium dynamics: The case of a Brownian gyrator
• Universal Excursion and Bridge shapes in ABBM/CIR/Bessel processes

Cited by in corpus (18)

• Time-resolved statistics of snippets as general framework for model-free entropy estimators
• Broken detailed balance and entropy production in directed networks
• Thermodynamic bounds for diffusion in non-equilibrium systems with multiple timescales
• Revealing the Nonequilibrium Nature of a Granular Intruder: The Crucial Role of Non-Gaussian Behavior
• Conceptual and practical approaches for investigating irreversible processes
• Variance sum rule: proofs and solvable models
• Entropy estimation for partially accessible Markov networks based on imperfect observations: Role of finite resolution and finite statistics
• The Fluctuation-Dissipation Relations: Growth, Diffusion, and Beyond
• Statistical features of systems driven by non-Gaussian processes: theory & practice
• Cooperative dynamics in two-component out-of-equilibrium systems: Molecular "spinning tops"
• Destructive effect of fluctuations on the performance of a Brownian gyrator
• Inference of Time-Reversal Asymmetry from Time Series in a Piezoelectric Energy Harvester
• Prediction and Inference: From Models and Data to Artificial Intelligence
• Force-free kinetic inference of entropy production
• Stochastic Model for a Piezoelectric Energy Harvester Driven by Broadband Vibrations
• Entropy production and irreversibility in the linearized stochastic Amari neural model
• Conservation laws and slow dynamics determine the universality class of interfaces in active matter
• Classification of diffusion processes in dimension $d$ via the Carleman approach with applications to models involving additive, multiplicative or square-root noises