The simplest model of jamming

Abstract

We study a well known machine learning model -the perceptron- as a simple model of jamming of hard objects. We exhibit two regimes: 1) a convex optimisation regime where jamming is hypostatic and non-critical. 2) a non convex optimisation regime where jamming is isostatic and critical. We characterise the critical jamming phase through exponents describing the distributions law of forces and gaps. Surprisingly we find that these exponents coincide with the corresponding ones recently computed in high dimensional hard spheres. In addition, modifying the perceptron to a random linear programming problem, we show that isostaticity is not a sufficient condition for singular force and gap distributions. For that, fragmentation of the space of solutions (replica symmetry breaking) appears to be a crucial ingredient. We hypothesise universality for a large class of non-convex constrained satisfaction problems with continuous variables.

References in corpus (8)

• Jamming at Zero Temperature and Zero Applied Stress: the Epitome of Disorder
• Fractal free energy landscapes in structural glasses
• Marginal Stability in Structural, Spin and Electron Glasses
• Universal Spectrum of Normal Modes in Low-Temperature Glasses: an Exact Solution
• Universal microstructure and mechanical stability of jammed packings
• Jamming Criticality Revealed by Removing Localized Buckling Excitations
• Exact theory of dense amorphous hard spheres in high dimension. I. The free energy
• Dynamic criticality at the jamming transition

Cited by in corpus (72)

• Glass and Jamming Transitions: From Exact Results to Finite-Dimensional Descriptions
• Universal Spectrum of Normal Modes in Low-Temperature Glasses: an Exact Solution
• Scaling description of generalization with number of parameters in deep learning
• Universality of the SAT-UNSAT (jamming) threshold in non-convex continuous constraint satisfaction problems
• The jamming transition as a paradigm to understand the loss landscape of deep neural networks
• A jamming transition from under- to over-parametrization affects loss landscape and generalization
• Universality of jamming of non-spherical particles
• Perspective: Gardner Physics in Amorphous Solids and Beyond
• Following the evolution of glassy states under external perturbations: the full replica symmetry breaking solution
• Generalized Lotka-Volterra equations with random, non-reciprocal interactions: the typical number of equilibria
• Out-of-equilibrium dynamical mean-field equations for the perceptron model
• Jamming in multilayer supervised learning models
• Storage capacity in symmetric binary perceptrons
• Mean-field model for the density of states of jammed soft spheres
• Critical jammed phase of the linear perceptron
• Constraint satisfaction mechanisms for marginal stability and criticality in large ecosystems
• Vibrational properties of hard and soft spheres are unified at jamming
• The jamming transition in high dimension: an analytical study of the TAP equations and the effective thermodynamic potential
• Vibrational density of states and specific heat in glasses from random matrix theory
• Triple descent and the two kinds of overfitting: Where & why do they appear?
• Universal non-mean-field scaling in the density of state of amorphous solids
• Interplay between percolation and glassiness in the random Lorentz gas
• Constrained optimization as ecological dynamics with applications to random quadratic programming in high dimensions
• The nature of non-phononic excitations in disordered systems
• On the role of synaptic stochasticity in training low-precision neural networks
• Mean-field caging in a random Lorentz gas
• Dynamical Mean-Field Theory and Aging Dynamics
• Disorder-free spin glass transitions and jamming in exactly solvable mean-field models
• Jamming with tunable roughness
• Finite size effects in the microscopic critical properties of jammed configurations: A comprehensive study of the effects of different types of disorder
• Beyond the storage capacity: data driven satisfiability transition
• Quenched complexity of equilibria for asymmetric Generalized Lotka-Volterra equations
• Impact of jamming criticality on low-temperature anomalies in structural glasses
• Critical energy landscape of linear soft spheres
• Jamming below upper critical dimension
• Quantum Jamming: Critical Properties of a Quantum Mechanical Perceptron
• From complex to simple : hierarchical free-energy landscape renormalized in deep neural networks
• Higher order corrections to the effective potential close to the jamming transition in the perceptron model
• A continuous constraint satisfaction problem for the rigidity transition in confluent tissues
• Introduction to the dynamics of disordered systems: equilibrium and gradient descent
• Jamming Criticality of Near-Crystals
• Jamming and replica symmetry breaking of weakly disordered crystals
• Mean field theory of jamming of nonspherical particles
• High dimensional optimization under non-convex excluded volume constraints
• Force balance controls the relaxation time of the gradient descent algorithm in the satisfiable phase
• Surfing on minima of isostatic landscapes: avalanches and unjamming transition
• Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks
• Hard-Sphere Jamming through the Lens of Linear Optimization
• Localization in random bipartite graphs: numerical and empirical study
• Dynamical mean field theory for models of confluent tissues and beyond
• Landscape Complexity for the Empirical Risk of Generalized Linear Models
• Tractability from overparametrization: The example of the negative perceptron
• Vibrational density of states of jammed packing: mean-field theory
• On the interplay between data structure and loss function in classification problems
• Pattern capacity of a single quantum perceptron
• The Copycat Perceptron: Smashing Barriers Through Collective Learning
• Proliferation of non-linear excitations in the piecewise-linear perceptron
• Self-planting: digging holes in rough landscapes
• A self-consistent current response theory of jamming and vibrational modes in low-temperature amorphous solids
• Non-Affine Displacements Below Jamming under Athermal Quasi-Static Compression
• Two-level systems and harmonic excitations in a mean-field anharmonic quantum glass
• On the topology of solutions to random continuous constraint satisfaction problems
• Subaging in underparametrized Deep Neural Networks
• The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions
• Fluctuation Distributions of Energy Minima in Complex Landscapes
• Rare Trajectories in a Prototypical Mean-field Disordered Model: Insights into Landscape and Instantons
• Phase transitions in integer linear problems
• Gradient descent dynamics and the jamming transition in infinite dimensions
• Interaction-free ergodicity-breaking driven by temporally hyperuniform noise
• Landscape Complexity for the Empirical Risk of Generalized Linear Models: Discrimination between Structured Data
• Critical properties of the SAT/UNSAT transitions in the classification problem of structured data
• Following the evolution of metastable glassy states under external perturbations: compression and shear-strain