Exact results on high-dimensional linear regression via statistical physics
arXiv:2009.13229 · doi:10.1103/PhysRevE.103.042142
Abstract
It is clear that conventional statistical inference protocols need to be revised to deal correctly with the high-dimensional data that are now common. Most recent studies aimed at achieving this revision rely on powerful approximation techniques, that call for rigorous results against which they can be tested. In this context, the simplest case of high-dimensional linear regression has acquired significant new relevance and attention. In this paper we use the statistical physics perspective on inference to derive a number of new exact results for linear regression in the high-dimensional regime.
arXiv commentMost recent version accepted for publication in Physical Review E
References in corpus (8)
- Statistical physics of inference: Thresholds and algorithms
- Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models
- Phase transitions in self-gravitating systems. Self-gravitating fermions and hard spheres models
- The Nishimori line and Bayesian Statistics
- Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation
- Replica analysis of overfitting in regression models for time-to-event data
- Statistical Mechanics of High-Dimensional Inference
- Asymptotic errors for convex penalized linear regression beyond Gaussian matrices