Kullback Leibler property of kernel mixture priors in Bayesian density estimation

Abstract

Positivity of the prior probability of Kullback-Leibler neighborhood around the true density, commonly known as the Kullback-Leibler property, plays a fundamental role in posterior consistency. A popular prior for Bayesian estimation is given by a Dirichlet mixture, where the kernels are chosen depending on the sample space and the class of densities to be estimated. The Kullback-Leibler property of the Dirichlet mixture prior has been shown for some special kernels like the normal density or Bernstein polynomial, under appropriate conditions. In this paper, we obtain easily verifiable sufficient conditions, under which a prior obtained by mixing a general kernel possesses the Kullback-Leibler property. We study a wide variety of kernel used in practice, including the normal, $t$, histogram, gamma, Weibull densities and so on, and show that the Kullback-Leibler property holds if some easily verifiable conditions are satisfied at the true density. This gives a catalog of conditions required for the Kullback-Leibler property, which can be readily used in applications.

Published in at http://dx.doi.org/10.1214/07-EJS130 the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (1)

• Posterior convergence rates of Dirichlet mixtures at smooth densities

Cited by in corpus (21)

• Rates of convergence for the posterior distributions of mixtures of Betas and adaptive nonparametric estimation of the density
• Adaptive nonparametric Bayesian inference using location-scale mixture priors
• On Posterior Concentration in Misspecified Models
• Bayes factor consistency
• Asymptotics for posterior hazards
• Concentration rate and consistency of the posterior under monotonicity constraints
• Finite mixture models do not reliably learn the number of components
• Estimating densities with nonlinear support using Fisher-Gaussian kernels
• Empirical priors and posterior concentration rates for a monotone density
• Adaptive density estimation based on a mixture of Gammas
• A note on Bayesian convergence rates under local prior support conditions
• Revisiting consistency of a recursive estimator of mixing distributions
• Bayesian Repulsive Gaussian Mixture Model
• Bayesian Semiparametric Markov Renewal Mixed Models for Vocalization Syntax
• A Nonparametric Bayesian Framework for Uncertainty Quantification in Stochastic Simulation
• Dirichlet process mixtures under affine transformations of the data
• Hellinger Distance and Bayesian Non-Parametrics: Hierarchical Models for Robust and Efficient Bayesian Inference
• Bayesian density regression for discrete outcomes
• Bayesian nonparametric location-scale-shape mixtures
• Nonparametric Bayesian estimation of a concave distribution function with mixed interval censored data
• On the Convergence of Bayesian Regression Models