High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models

Abstract

We study Langevin dynamics for recovering the planted signal in the spiked matrix model. We provide a "path-wise" characterization of the overlap between the output of the Langevin algorithm and the planted signal. This overlap is characterized in terms of a self-consistent system of integro-differential equations, usually referred to as the Crisanti-Horner-Sommers-Cugliandolo-Kurchan (CHSCK) equations in the spin glass literature. As a second contribution, we derive an explicit formula for the limiting overlap in terms of the signal-to-noise ratio and the injected noise in the diffusion. This uncovers a sharp phase transition -- in one regime, the limiting overlap is strictly positive, while in the other, the injected noise overcomes the signal, and the limiting overlap is zero.

arXiv comment26 pages

References in corpus (8)

• Analytical Solution of the Off-Equilibrium Dynamics of a Long Range Spin-Glass Model
• Out-of-equilibrium dynamical mean-field equations for the perceptron model
• A Precise High-Dimensional Asymptotic Theory for Boosting and Minimum-${\ell }_1$-Norm Interpolated Classifiers
• Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regime
• Bounding flows for spherical spin glass dynamics
• The high-dimensional asymptotics of first order methods with random data
• Dynamics for spherical spin glasses: disorder dependent initial conditions
• Thresholds of descending algorithms in inference problems