Bayesian Fusion Estimation via t-Shrinkage

Abstract

Shrinkage prior has gained great successes in many data analysis, however, its applications mostly focus on the Bayesian modeling of sparse parameters. In this work, we will apply Bayesian shrinkage to model high dimensional parameter that possesses an unknown blocking structure. We propose to impose heavy-tail shrinkage prior, e.g., $t$ prior, on the differences of successive parameter entries, and such a fusion prior will shrink successive differences towards zero and hence induce posterior blocking. Comparing to conventional Bayesian fused lasso which implements Laplace fusion prior, $t$ fusion prior induces stronger shrinkage effect and enjoys a nice posterior consistency property. Simulation studies and real data analyses show that $t$ fusion has superior performance to the frequentist fusion estimator and Bayesian Laplace-fusion prior. This $t$-fusion strategy is further developed to conduct a Bayesian clustering analysis, and simulation shows that the proposed algorithm obtains better posterior distributional convergence than the classical Dirichlet process modeling.

References in corpus (8)

• Nearly unbiased variable selection under minimax concave penalty
• Spike and slab variable selection: Frequentist and Bayesian strategies
• Bayesian cluster analysis: Point estimation and credible balls
• Discussion on Bayesian Cluster Analysis: Point Estimation and Credible Balls by Sara Wade and Zoubin Ghahramani
• Bayesian Fused Lasso regression for dynamic binary networks
• Bayesian Sparse Global-Local Shrinkage Regression for Selection of Grouped Variables
• Mean-field theory of Bayesian clustering
• Bayesian Variable Selection and Estimation Based on Global-Local Shrinkage Priors