Consistency of a recursive estimate of mixing distributions

Abstract

Mixture models have received considerable attention recently and Newton [Sankhyā Ser. A 64 (2002) 306--322] proposed a fast recursive algorithm for estimating a mixing distribution. We prove almost sure consistency of this recursive estimate in the weak topology under mild conditions on the family of densities being mixed. This recursive estimate depends on the data ordering and a permutation-invariant modification is proposed, which is an average of the original over permutations of the data sequence. A Rao--Blackwell argument is used to prove consistency in probability of this alternative estimate. Several simulations are presented, comparing the finite-sample performance of the recursive estimate and a Monte Carlo approximation to the permutation-invariant alternative along with that of the nonparametric maximum likelihood estimate and a nonparametric Bayes estimate.

arXiv commentPublished in at http://dx.doi.org/10.1214/08-AOS639 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• A comparison of the Benjamini-Hochberg procedure with some Bayesian rules for multiple testing
• Stochastic Approximation and Newton's Estimate of a Mixing Distribution

Cited by in corpus (16)

• A nonparametric empirical Bayes framework for large-scale multiple testing
• On recursive Bayesian predictive distributions
• Stochastic Approximation and Newton's Estimate of a Mixing Distribution
• Semiparametric inference in mixture models with predictive recursion marginal likelihood
• A semiparametric scale-mixture regression model and predictive recursion maximum likelihood
• Optimal post-selection inference for sparse signals: a nonparametric empirical-Bayes approach
• Applications of an algorithm for solving Fredholm equations of the first kind
• Convergence rate for predictive recursion estimation of finite mixtures
• An approximate Bayesian marginal likelihood approach for estimating finite mixtures
• Fast nonparametric near-maximum likelihood estimation of a mixing density
• On nonparametric estimation of a mixing density via the predictive recursion algorithm
• A class of measure-valued Markov chains and Bayesian nonparametrics
• Revisiting consistency of a recursive estimator of mixing distributions
• Estimating a mixing distribution on the sphere using predictive recursion
• Anytime valid and asymptotically optimal inference driven by predictive recursion
• A PRticle filter algorithm for nonparametric estimation of multivariate mixing distributions