Two-component Mixture Model in the Presence of Covariates

Abstract

In this paper, we study a generalization of the two-groups model in the presence of covariates --- a problem that has recently received much attention in the statistical literature due to its applicability in multiple hypotheses testing problems. The model we consider allows for infinite dimensional parameters and offers flexibility in modeling the dependence of the response on the covariates. We discuss the identifiability issues arising in this model and systematically study several estimation strategies. We propose a tuning parameter-free nonparametric maximum likelihood method, implementable via the EM algorithm, to estimate the unknown parameters. Further, we derive the rate of convergence of the proposed estimators --- in particular, we show that the finite sample Hellinger risk for every `approximate' nonparametric maximum likelihood estimator achieves a near-parametric rate (up to logarithmic multiplicative factors). In addition, we propose and theoretically study two `marginal' methods that are more scalable and easily implementable. We demonstrate the efficacy of our procedures through extensive simulation studies and relevant data analyses --- one arising from neuroscience and the other from astronomy. We also outline the application of our methods to multiple testing. The companion R package $\text{NPMLEmix}$ implements all the procedures proposed in this paper.

arXiv comment88 pages, 15 figures

References in corpus (8)

• Brownian distance covariance
• Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
• Stellar Velocities in the Carina, Fornax, Sculptor and Sextans dSph Galaxies: Data from the Magellan/MMFS Survey
• Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
• Projection onto the probability simplex: An efficient algorithm with a simple proof, and an application
• Clean Kinematic Samples in Dwarf Spheroidals: An Algorithm for Evaluating Membership and Estimating Distribution Parameters When Contamination is Present
• Multiple testing with the structure adaptive Benjamini-Hochberg algorithm
• Nonparametric empirical Bayes and maximum likelihood estimation for high-dimensional data analysis