Filling the gaps: Gaussian mixture models from noisy, truncated or incomplete samples
arXiv:1611.05806 · doi:10.1016/j.ascom.2018.09.013
Abstract
Astronomical data often suffer from noise and incompleteness. We extend the common mixtures-of-Gaussians density estimation approach to account for situations with a known sample incompleteness by simultaneous imputation from the current model. The method, called GMMis, generalizes existing Expectation-Maximization techniques for truncated data to arbitrary truncation geometries and probabilistic rejection processes, as long as they can be specified and do not depend on the density itself. The method accounts for independent multivariate normal measurement errors for each of the observed samples and recovers an estimate of the error-free distribution from which both observed and unobserved samples are drawn. It can perform a separation of a mixtures-of-Gaussian signal from a specified background distribution whose amplitude may be unknown. We compare GMMis to the standard Gaussian mixture model for simple test cases with different types of incompleteness, and apply it to observational data from the NASA Chandra X-ray telescope. The python code is released as an open-source package at https://github.com/pmelchior/pyGMMis
13 pages, 5 figures, post-publication extension of section 2.3
References in corpus (1)
Cited by in corpus (14)
- Earthquake Phase Association using a Bayesian Gaussian Mixture Model
- Gaia DR2 unravels incompleteness of nearby cluster population: New open clusters in the direction of Perseus
- SPICY: The Spitzer/IRAC Candidate YSO Catalog for the Inner Galactic Midplane
- A robust estimator of mutual information for deep learning interpretability
- Mixture Models for Photometric Redshifts
- A Unified Exploration of the Chronology of the Galaxy
- The SRG/eROSITA all-sky survey: The morphologies of clusters of galaxies I: A catalogue of morphological parameters
- Classification of Pulsar Glitch Amplitudes using Extreme Deconvolution
- Revealing the dust grain polarization properties as a function of extinction and distance towards NGC 1893
- Predicting exoplanet mass from radius and incident flux: A Bayesian mixture model
- Red Dragon: A Redshift-Evolving Gaussian Mixture Model for Galaxies
- A Comparative Study of Dust Grain Polarisation Efficiencies in the Interstellar and Intracluster Mediums towards Anti-Center Galaxy
- Data-Space Validation of High-Dimensional Models by Comparing Sample Quantiles
- Probabilistic partition of unity networks for high-dimensional regression problems