Generalized Beta Mixtures of Gaussians

Abstract

In recent years, a rich variety of shrinkage priors have been proposed that have great promise in addressing massive regression problems. In general, these new priors can be expressed as scale mixtures of normals, but have more complex forms and better properties than traditional Cauchy and double exponential priors. We first propose a new class of normal scale mixtures through a novel generalized beta distribution that encompasses many interesting priors as special cases. This encompassing framework should prove useful in comparing competing priors, considering properties and revealing close connections. We then develop a class of variational Bayes approximations through the new hierarchy presented that will scale more efficiently to the types of truly massive data sets that are now encountered routinely.

Advances in Neural Information Processing Systems 24 edited by J. Shawe-Taylor and R.S. Zemel and P. Bartlett and F. Pereira and K.Q. Weinberger (2011)

Cited by in corpus (25)

• Bayesian Compression for Deep Learning
• Model-based clustering based on sparse finite Gaussian mixtures
• Projective Inference in High-dimensional Problems: Prediction and Feature Selection
• Bayesian Sparse Factor Analysis of Genetic Covariance Matrices
• Posterior consistency in linear models under shrinkage priors
• Nearly optimal Bayesian Shrinkage for High Dimensional Regression
• High-Dimensional Multivariate Posterior Consistency Under Global-Local Shrinkage Priors
• Sparse Multi-Output Gaussian Processes for Medical Time Series Prediction
• Learning Deep Generative Models with Doubly Stochastic MCMC
• Horseshoe Regularization for Feature Subset Selection
• Bayesian group latent factor analysis with structured sparsity
• On Global-local Shrinkage Priors for Count Data
• The Inverse G-Wishart Distribution and Variational Message Passing
• The Beta-Mixture Shrinkage Prior for Sparse Covariances with Posterior Minimax Rates
• Non-Gaussian Discriminative Factor Models via the Max-Margin Rank-Likelihood
• Log-Scale Shrinkage Priors and Adaptive Bayesian Global-Local Shrinkage Estimation
• Ultra High-dimensional Multivariate Posterior Contraction Rate Under Shrinkage Priors
• Hierarchical sparsity priors for regression models
• CBA: Contextual Quality Adaptation for Adaptive Bitrate Video Streaming (Extended Version)
• Evaluating the impact of local tracing partnerships on the performance of contact tracing for COVID-19 in England
• Asymptotic Minimaxity, Optimal Posterior Concentration and Asymptotic Bayes Optimality of Horseshoe-type Priors Under Sparsity
• Inference on High-Dimensional Sparse Count Data
• Multiscale Shrinkage and Lévy Processes
• Supervised Multiscale Dimension Reduction for Spatial Interaction Networks
• HALO: Learning to Prune Neural Networks with Shrinkage