Fluctuation Distributions of Energy Minima in Complex Landscapes

Abstract

We discuss the properties of the distributions of energies of minima obtained by gradient descent in complex energy landscapes. We find strikingly similar phenomenology across several prototypical models. We particularly focus on the distribution of energies of minima in the analytically well-understood p-spin-interaction spin glass model. We numerically find non-Gaussian distributions that resemble the Tracy-Widom distributions often found in problems of random correlated variables, and non-trivial finite-size scaling. Based on this, we propose a picture of gradient descent dynamics that highlights the importance of a first-passage process in the eigenvalues of the Hessian. This picture provides a concrete link to problems in which the Tracy-Widom distribution is established. Aspects of this first-passage view of gradient-descent dynamics are generic for non-convex complex landscapes, rationalizing the commonality that we find across models.

arXiv comment11 pages, 5 figures

References in corpus (28)

• Theoretical perspective on the glass transition and amorphous materials
• Level-Spacing Distributions and the Airy Kernel
• Jamming at Zero Temperature and Zero Applied Stress: the Epitome of Disorder
• Analytical Solution of the Off-Equilibrium Dynamics of a Long Range Spin-Glass Model
• The relationship between fragility, configurational entropy and the potential energy landscape of glass forming liquids
• Fractal free energy landscapes in structural glasses
• Inherent Structure Entropy of Supercooled Liquids
• The random K-satisfiability problem: from an analytic solution to an efficient algorithm
• Level-Spacing Distributions and the Airy Kernel
• Recipes for metastable states in Spin Glasses
• Large Deviations of Extreme Eigenvalues of Random Matrices
• Extreme Value Statistics of Eigenvalues of Gaussian Random Matrices
• Universal Spectrum of Normal Modes in Low-Temperature Glasses: an Exact Solution
• Phase space geometry and slow dynamics
• A Landscape Analysis of Constraint Satisfaction Problems
• Top eigenvalue of a random matrix: large deviations and third order phase transition
• The simplest model of jamming
• Universality of the SAT-UNSAT (jamming) threshold in non-convex continuous constraint satisfaction problems
• Finite-Size-Scaling at the Jamming Transition: Corrections to Scaling and the Correlation Length Critical Exponent
• Direct determination of the size of basins of attraction of jammed solids
• A simple derivation of the Tracy-Widom distribution of the maximal eigenvalue of a Gaussian unitary random matrix
• Mean-field model for the density of states of jammed soft spheres
• The Complexity of the Spherical $p$-spin spin glass model, revisited
• A random matrix definition of the boson peak
• A simple random matrix model for the vibrational spectrum of jammed packings
• Energy Landscape of the Finite-Size Mean-field 3-Spin Spherical Model
• Monte Carlo sampling for stochastic weight functions
• Tuning and jamming reduced to their minima

Cited by in corpus (1)

• Gradient descent dynamics in the mixed $p$-spin spherical model: finite size simulation and comparison with mean-field integration