Borrowing strengh in hierarchical Bayes: Posterior concentration of the Dirichlet base measure

Abstract

This paper studies posterior concentration behavior of the base probability measure of a Dirichlet measure, given observations associated with the sampled Dirichlet processes, as the number of observations tends to infinity. The base measure itself is endowed with another Dirichlet prior, a construction known as the hierarchical Dirichlet processes (Teh et al. [J. Amer. Statist. Assoc. 101 (2006) 1566-1581]). Convergence rates are established in transportation distances (i.e., Wasserstein metrics) under various conditions on the geometry of the support of the true base measure. As a consequence of the theory, we demonstrate the benefit of "borrowing strength" in the inference of multiple groups of data - a powerful insight often invoked to motivate hierarchical modeling. In certain settings, the gain in efficiency due to the latent hierarchy can be dramatic, improving from a standard nonparametric rate to a parametric rate of convergence. Tools developed include transportation distances for nonparametric Bayesian hierarchies of random measures, the existence of tests for Dirichlet measures, and geometric properties of the support of Dirichlet measures.

Published at http://dx.doi.org/10.3150/15-BEJ703 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

References in corpus (7)

• Rates of contraction of posterior distributions based on Gaussian process priors
• Convergence of latent mixing measures in finite and infinite mixture models
• Rates of contraction for posterior distributions in $\bolds{L^r}$-metrics, $\bolds{1\le r\le\infty}$
• On rates of convergence for posterior distributions in infinite-dimensional models
• About the posterior distribution in hidden Markov models with unknown number of states
• Posterior contraction of the population polytope in finite admixture models
• The local geometry of finite mixtures

Cited by in corpus (3)

• Quantifying Observed Prior Impact
• Matching Distributions via Optimal Transport for Semi-Supervised Learning
• On Efficient Multilevel Clustering via Wasserstein Distances