A new class of generalized Bayes minimax ridge regression estimators

Abstract

Let y=Aβ+ε, where y is an N\times1 vector of observations, βis a p\times1 vector of unknown regression coefficients, A is an N\times p design matrix and εis a spherically symmetric error term with unknown scale parameter σ. We consider estimation of βunder general quadratic loss functions, and, in particular, extend the work of Strawderman [J. Amer. Statist. Assoc. 73 (1978) 623-627] and Casella [Ann. Statist. 8 (1980) 1036-1056, J. Amer. Statist. Assoc. 80 (1985) 753-758] by finding adaptive minimax estimators (which are, under the normality assumption, also generalized Bayes) of β, which have greater numerical stability (i.e., smaller condition number) than the usual least squares estimator. In particular, we give a subclass of such estimators which, surprisingly, has a very simple form. We also show that under certain conditions the generalized Bayes minimax estimators in the normal case are also generalized Bayes and minimax in the general case of spherically symmetric errors.

Published at http://dx.doi.org/10.1214/009053605000000327 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Cited by in corpus (16)

• Fully Bayes factors with a generalized g-prior
• Bayesian predictive densities for linear regression models under alpha-divergence loss: some results and open problems
• On the Optimal Weighted ${\ell }_2$ Regularization in Overparameterized Linear Regression
• A Bayes factor with reasonable model selection consistency for ANOVA model
• Stein Estimation for Spherically Symmetric Distributions: Recent Developments
• An extended class of minimax generalized Bayes estimators of regression coefficients
• Robust Bayesian variable selection with sub-harmonic priors
• Predictive density estimation under the Wasserstein loss
• Bayesian Predictive Density Estimation for a Chi-squared Model Using Information from a Normal Observation with Unknown Mean and Variance
• AIC, Cp and estimators of loss for elliptically symmetric distributions
• Regularization and Bayesian Learning in Dynamical Systems: Past, Present and Future
• Admissible estimators of a multivariate normal mean vector when the scale is unknown
• Improved robust Bayes estimators of the error variance in linear models
• Estimation of a nonnegative location parameter with unknown scale
• Dropout Drops Double Descent
• Admissible Bayes equivariant estimation of location vectors for spherically symmetric distributions with unknown scale