When you can't count, sample! Computable entropies beyond equilibrium from basin volumes
arXiv:2207.08241 · doi:10.4279/pip.150001
Abstract
In statistical mechanics, measuring the number of available states and their probabilities, and thus the system's entropy, enables the prediction of the macroscopic properties of a physical system at equilibrium. This predictive capacity hinges on the knowledge of the a priori probabilities of observing the states of the system, given by the Boltzmann distribution. Unfortunately, the successes of equilibrium statistical mechanics are hard to replicate out of equilibrium, where the a priori probabilities of observing states are in general not known, precluding the naïve application of usual tools. In the last decade, exciting developments have occurred that enable the direct numerical estimation of the entropy and density of states of athermal and non-equilibrium systems, thanks to significant methodological advances in the computation of the volume of high-dimensional basins of attraction. Here, we provide a detailed account of these methods, underscoring the challenges that lie in such estimations, recent progress on the matter, and promising directions for future work.
arXiv comment18 pages, 11 figures
References in corpus (52)
- Mean field theory of hard sphere glasses and jamming
- Spin-Glass Theory for Pedestrians
- Realistic Control of Network Dynamics
- Recipes for metastable states in Spin Glasses
- A Landscape Analysis of Constraint Satisfaction Problems
- A deductive statistical mechanics approach for granular matter
- Freezing Transition, Characteristic Polynomials of Random Matrices, and the Riemann Zeta-Function
- Configurational entropy measurements in extremely supercooled liquids that break the glass ceiling
- Hiding Quiet Solutions in Random Constraint Satisfaction Problems
- Perspective: Configurational entropy of glass-forming liquids
- Jamming in finite systems: stability, anisotropy, fluctuations and scaling
- Numerical calculation of granular entropy
- Equilibrating temperature-like variables in jammed granular subsystems
- Properties of equilibria and glassy phases of the random Lotka-Volterra model with demographic noise
- Perspective: Energy Landscapes for Machine Learning
- Understanding the Frequency Distribution of Mechanically Stable Disk Packings
- The Penalty Method for Random Walks with Uncertain Energies
- Parallel Excluded Volume Tempering for Polymer Melts
- Shaping the learning landscape in neural networks around wide flat minima
- Microscopic origin of excess wings in relaxation spectra of supercooled liquids
- Critical Behaviour of the Number of Minima of a Random Landscape at the Glass Transition Point and the Tracy-Widom distribution
- Play. Pause. Rewind. Measuring local entropy production and extractable work in active matter
- Determining pressure-temperature phase diagrams of materials
- Universal and accessible entropy estimation using a compression algorithm
- Direct determination of the size of basins of attraction of jammed solids
- Turning intractable counting into sampling: computing the configurational entropy of three-dimensional jammed packings
- Volume fluctuations and geometrical constraints in granular packs
- Numerical test of the Edwards conjecture shows that all packings are equally probable at jamming
- Constant-pressure nested sampling with atomistic dynamics
- On the number of connected components of random algebraic hypersurfaces
- High Probability Analysis of the Condition Number of Sparse Polynomial Systems
- Estimating random close packing in polydisperse and bidisperse hard spheres via an equilibrium model of crowding
- Experimental Test on Edwards Volume Ensemble of Tapped Granular Packings
- Calculations of the Structure of Basin Volumes for Mechanically Stable Packings
- Relaxation dynamics in the energy landscape of glass-forming liquids
- Friction-controlled entropy-stability competition in granular systems
- High-Dimensional Random Fields and Random Matrix Theory
- Protocol-Dependence and State Variables in the Force-Moment Ensemble
- Measuring the configurational temperature of a binary disc packing
- Entropic gradient descent algorithms and wide flat minima
- Path Integral Approach Unveils the Role of Complex Energy Landscape for Activated Dynamics of Glassy Systems
- Structural analysis of high-dimensional basins of attraction
- Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval
- Counting equilibria in a random non-gradient dynamics with heterogeneous relaxation rates
- Monte Carlo sampling for stochastic weight functions
- Nonperturbative fluctuations and metastability in a simple model: from observables to microscopic theory and back
- On the Explicit Height Distribution and Expected Number of Local Maxima of Isotropic Gaussian Random Fields
- Vicsek Model by Time-Interlaced Compression: a Dynamical Computable Information Density
- Correlation lengths in the language of computable information
- Introduction to the dynamics of disordered systems: equilibrium and gradient descent
- Efficient computation of the volume of a polytope in high-dimensions using Piecewise Deterministic Markov Processes
- Why flatness does and does not correlate with generalization for deep neural networks