Uniform Consistency in Nonparametric Mixture Models

Abstract

We study uniform consistency in nonparametric mixture models as well as closely related mixture of regression (also known as mixed regression) models, where the regression functions are allowed to be nonparametric and the error distributions are assumed to be convolutions of a Gaussian density. We construct uniformly consistent estimators under general conditions while simultaneously highlighting several pain points in extending existing pointwise consistency results to uniform results. The resulting analysis turns out to be nontrivial, and several novel technical tools are developed along the way. In the case of mixed regression, we prove $L^1$ convergence of the regression functions while allowing for the component regression functions to intersect arbitrarily often, which presents additional technical challenges. We also consider generalizations to general (i.e. non-convolutional) nonparametric mixtures.

arXiv commentTo appear in The Annals of Statistics

References in corpus (13)

• Identifiability of parameters in latent structure models with many observed variables
• Nonparametric modal regression
• Inference for mixtures of symmetric distributions
• Data spectroscopy: Eigenspaces of convolution operators and clustering
• Alternating Minimization for Mixed Linear Regression
• Conditional density estimation in a regression setting
• Estimation of the density of regression errors
• EM Converges for a Mixture of Many Linear Regressions
• Convergence Rates for Gaussian Mixtures of Experts
• Non parametric finite translation mixtures with dependent regime
• A Convex Program for Mixed Linear Regression with a Recovery Guarantee for Well-Separated Data
• Consistent Estimation of Identifiable Nonparametric Mixture Models from Grouped Observations
• Nonparametric Analysis of Finite Mixtures