Information density, structure and entropy in equilibrium and non-equilibrium systems

Abstract

During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides an interpretation of entropy in terms of probabilities. However, we cannot rely on the statistical-mechanical expressions for entropy in systems that are far from equilibrium. In this paper, we compare various extensions of the definition of entropy, which have been proposed for non-equilibrium systems. It has recently been proposed that measures of information density may serve to quantify entropy in both equilibrium and nonequilibrium systems. We propose a new "bit-wise" method to measure the information density for off lattice systems. This method does not rely on coarse-graining of the particle coordinates. We then compare different estimates of the system entropy, based on information density and on the structural properties of the system, and check if the various entropies are mutually consistent and, importantly, whether they can detect non-trivial ordering phenomena. We find that, except for simple (one-dimensional) cases, the different methods yield answers that are at best qualitatively similar, and often not even that, although in several cases, different entropy estimates do detect ordering phenomena qualitatively. Our entropy estimates based on bit-wise data compression contain no adjustable scaling factor, and show large quantitative differences with the thermodynamic entropy obtained from equilibrium simulations. Hence, our results suggest that, at present, there is not yet a single, structure-based entropy definition that has general validity for equilibrium and non equilibrium systems.

References in corpus (14)

• Jamming at Zero Temperature and Zero Applied Stress: the Epitome of Disorder
• Motility-driven glass and jamming transitions in biological tissues
• Determination of phase diagrams via computer simulation: Methodology and applications to water, electrolytes and proteins
• Jamming transitions in amorphous packings of frictionless spheres occur over a continuous range of volume fractions
• The yielding transition in amorphous solids under oscillatory shear deformation
• Numerical calculation of granular entropy
• Quantifying hidden order out of equilibrium
• Density affects the nature of the hexatic-liquid transition in two-dimensional melting of core-softened systems
• Universal and accessible entropy estimation using a compression algorithm
• Direct determination of the size of basins of attraction of jammed solids
• Turning intractable counting into sampling: computing the configurational entropy of three-dimensional jammed packings
• Determination of onset temperature from the entropy for fragile to strong liquids
• Analysis of the phase transition in the $2D$ Ising ferromagnet using a Lempel-Ziv string parsing scheme and black-box data-compression utilities
• Lempel-Ziv complexity analysis of one dimensional cellular automata

Cited by in corpus (8)

• Machine-learning Iterative Calculation of Entropy for Physical Systems
• Inferring entropy from structure
• Universal Relation between Entropy and Kinetics
• Mutual information as a measure of mixing efficiency in viscous fluids
• Complexity Scaling of Liquid Dynamics
• Detecting and characterizing phase transitions in active matter using entropy
• Unraveling liquid polymorphism in silicon driven out-of-equilibrium
• Resolving entropy contributions in nonequilibrium transitions