Posterior convergence rates of Dirichlet mixtures at smooth densities

Abstract

We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twice continuously differentiable. The bandwidth is given a sequence of priors which is obtained by scaling a single prior by an appropriate order. In order to handle this problem, we derive a new general rate theorem by considering a countable covering of the parameter space whose prior probabilities satisfy a summability condition together with certain individual bounds on the Hellinger metric entropy. We apply this new general theorem on posterior convergence rates by computing bounds for Hellinger (bracketing) entropy numbers for the involved class of densities, the error in the approximation of a smooth density by normal mixtures and the concentration rate of the prior. The best obtainable rate of convergence of the posterior turns out to be equivalent to the well-known frequentist rate for integrated mean squared error $n^{-2/5}$ up to a logarithmic factor.

Published at http://dx.doi.org/10.1214/009053606000001271 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (1)

• Misspecification in infinite-dimensional Bayesian statistics

Cited by in corpus (10)

• Rates of contraction of posterior distributions based on Gaussian process priors
• General maximum likelihood empirical Bayes estimation of normal means
• Convergence rates of posterior distributions for noniid observations
• Kullback Leibler property of kernel mixture priors in Bayesian density estimation
• Rates of contraction for posterior distributions in $\bolds{L^r}$-metrics, $\bolds{1\le r\le\infty}$
• A Bernstein-Von Mises Theorem for discrete probability distributions
• Adaptive nonparametric Bayesian inference using location-scale mixture priors
• Clustering consistency with Dirichlet process mixtures
• Nonparametric Bayesian model selection and averaging
• Bayesian mixture models (in)consistency for the number of clusters