Estimation in the spiked Wigner model: A short proof of the replica formula
arXiv:1801.01593 · doi:10.1109/ISIT.2018.8437810
Abstract
We consider the problem of estimating a rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per variable between the spike and the observed matrix, or equivalently, the normalized Kullback-Leibler divergence between the planted and null models are known to converge to the so-called {\em replica-symmetric} formula, the properties of which determine the fundamental limits of estimation in this model. We provide in this note a short and transparent proof of this formula, based on simple executions of Gaussian interpolations and standard concentration-of-measure arguments. The \emph{Franz-Parisi potential}, that is, the free entropy at a fixed overlap, plays an important role in our proof. Furthermore, our proof can be generalized straightforwardly to spiked tensor models of even order.
arXiv comment11 pages. Appears in proc. of the IEEE International Symposium on Information Theory (ISIT) 2018
References in corpus (9)
- The Thermodynamic Limit in Mean Field Spin Glass Models
- Recipes for metastable states in Spin Glasses
- An Extended Variational Principle for the SK Spin-Glass Model
- Effective potential in glassy systems: theory and simulations
- Mutual Information in Rank-One Matrix Estimation
- Statistical and computational phase transitions in spiked tensor estimation
- A note on classical ground state energies
- Phase Transitions in Sparse PCA
- Finite Size Corrections and Likelihood Ratio Fluctuations in the Spiked Wigner Model
Cited by in corpus (10)
- The adaptive interpolation method for proving replica formulas. Applications to the Curie-Weiss and Wigner spike models
- Fundamental limits of detection in the spiked Wigner model
- Perturbative construction of mean-field equations in extensive-rank matrix factorization and denoising
- Estimating rank-one matrices with mismatched prior and noise: universality and large deviations
- Strong replica symmetry for high-dimensional disordered log-concave Gibbs measures
- An Information-Percolation Bound for Spin Synchronization on General Graphs
- Mutual information for low-rank even-order symmetric tensor estimation
- Low-rank Matrix Estimation with Inhomogeneous Noise
- Asymptotic mutual information in quadratic estimation problems over compact groups
- Existence of long-range order in random-field Ising model on Dyson hierarchical lattice