Exact minimax estimation of the predictive density in sparse Gaussian models

Abstract

We consider estimating the predictive density under Kullback-Leibler loss in an ${\ell }_0$ sparse Gaussian sequence model. Explicit expressions of the first order minimax risk along with its exact constant, asymptotically least favorable priors and optimal predictive density estimates are derived. Compared to the sparse recovery results involving point estimation of the normal mean, new decision theoretic phenomena are seen. Suboptimal performance of the class of plug-in density estimates reflects the predictive nature of the problem and optimal strategies need diversification of the future risk. We find that minimax optimal strategies lie outside the Gaussian family but can be constructed with threshold predictive density estimates. Novel minimax techniques involving simultaneous calibration of the sparsity adjustment and the risk diversification mechanisms are used to design optimal predictive density estimates.

Published at http://dx.doi.org/10.1214/14-AOS1251 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (8)

• Improved minimax predictive densities under Kullback--Leibler loss
• Admissible predictive density estimation
• From Minimax Shrinkage Estimation to Minimax Shrinkage Prediction
• Accurate Prediction of Phase Transitions in Compressed Sensing via a Connection to Minimax Denoising
• Asymptotic minimax risk of predictive density estimation for non-parametric regression
• Asymptotically minimax Bayes predictive densities
• Optimal Estimation and Prediction for Dense Signals in High-Dimensional Linear Models
• Shrinkage estimators for prediction out-of-sample: Conditional performance

Cited by in corpus (6)

• Empirical priors for prediction in sparse high-dimensional linear regression
• Methods to Compute Prediction Intervals: A Review and New Results
• Asymptotically Minimax Prediction in Infinite Sequence Models
• Minimax Predictive Density for Sparse Count Data
• On the within-family Kullback-Leibler risk in Gaussian Predictive models
• Sparse Minimax Optimality of Bayes Predictive Density Estimates from Clustered Discrete Priors