Computational Barriers to Estimation from Low-Degree Polynomials

Abstract

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for such problems: it has been demonstrated in various settings that low-degree polynomials of the data can match the statistical performance of the best known polynomial-time algorithms. Prior work has studied the power of low-degree polynomials for the task of detecting the presence of hidden structures. In this work, we extend these methods to address problems of estimation and recovery (instead of detection). For a large class of "signal plus noise" problems, we give a user-friendly lower bound for the best possible mean squared error achievable by any degree-D polynomial. To our knowledge, these are the first results to establish low-degree hardness of recovery problems for which the associated detection problem is easy. As applications, we give a tight characterization of the low-degree minimum mean squared error for the planted submatrix and planted dense subgraph problems, resolving (in the low-degree framework) open problems about the computational complexity of recovery in both cases.

v2 adds new results on planted clique

References in corpus (16)

• Finding large average submatrices in high dimensional data
• A statistical model for tensor PCA
• Tensor principal component analysis via sum-of-squares proofs
• Computational Lower Bounds for Community Detection on Random Graphs
• Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalent
• Reducibility and Statistical-Computational Gaps from Secret Leakage
• Optimal Average-Case Reductions to Sparse PCA: From Weak Assumptions to Strong Hardness
• All-or-nothing statistical and computational phase transitions in sparse spiked matrix estimation
• A Robust Spectral Algorithm for Overcomplete Tensor Decomposition
• Spectral Planting and the Hardness of Refuting Cuts, Colorability, and Communities in Random Graphs
• Counterexamples to the Low-Degree Conjecture
• Statistical Query Lower Bounds for Tensor PCA
• A greedy anytime algorithm for sparse PCA
• Computationally efficient sparse clustering
• The Overlap Gap Property and Approximate Message Passing Algorithms for $p$-spin models
• Statistical and Computational Limits for Sparse Matrix Detection

Cited by in corpus (7)

• Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalent
• Matrix denoising: Bayes-optimal estimators via low-degree polynomials
• Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomials
• Group testing and local search: is there a computational-statistical gap?
• Some observations on the ambivalent role of symmetries in Bayesian inference problems
• Hypothesis testing with low-degree polynomials in the Morris class of exponential families
• Precise Error Rates for Computationally Efficient Testing