Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
arXiv:1403.0044 · doi:10.1093/mnras/stu1098
Abstract
The estimation and utilization of photometric redshift probability density functions (photo- PDFs) has become increasingly important over the last few years and currently there exist a wide variety of algorithms to compute photo-'s, each with their own strengths and weaknesses. In this paper, we present a novel and efficient Bayesian framework that combines the results from different photo- techniques into a more powerful and robust estimate by maximizing the information from the photometric data. To demonstrate this we use a supervised machine learning technique based on random forest, an unsupervised method based on self-organizing maps, and a standard template fitting method but can be easily extend to other existing techniques. We use data from the DEEP2 and the SDSS surveys to explore different methods for combining the predictions from these techniques. By using different performance metrics, we demonstrate that we can improve the accuracy of our final photo- estimate over the best input technique, that the fraction of outliers is reduced, and that the identification of outliers is significantly improved when we apply a Na\"ıve Bayes Classifier to this combined information. Our more robust and accurate photo- PDFs will allow even more precise cosmological constraints to be made by using current and future photometric surveys. These improvements are crucial as we move to analyze photometric data that push to or even past the limits of the available training data, which will be the case with the Large Synoptic Survey Telescope.
21 pages, 19 figures, minor corrections, accepted for publication to MNRAS
References in corpus (9)
- The Zurich Extragalactic Bayesian Redshift Analyzer (ZEBRA) and its first application: COSMOS
- Estimating the Redshift Distribution of Faint Galaxy Samples
- Automated supervised classification of variable stars I. Methodology
- Precision photometric redshift calibration for galaxy-galaxy weak lensing
- SOMz: photometric redshift PDFs with self organizing maps and random atlas
- Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
- Extended Photometry for the DEEP2 Galaxy Redshift Survey: A Testbed for Photometric Redshift Experiments
- Bayesian Model Averaging in Astrophysics: A Review
- Sparse Representation of Photometric Redshift PDFs: Preparing for Petascale Astronomy
Cited by in corpus (49)
- The Dark Energy Survey: more than dark energy - an overview
- Star-galaxy Classification Using Deep Convolutional Neural Networks
- Photometric redshifts from SDSS images using a Convolutional Neural Network
- Photometric redshift analysis in the Dark Energy Survey Science Verification data
- The LOFAR window on star-forming galaxies and AGN - curved radio SEDs and IR-radio correlation at
- Galaxy clustering, photometric redshifts and diagnosis of systematics in the DES Science Verification data
- Photometric redshifts for the next generation of deep radio continuum surveys - I: Template fitting
- Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)
- METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
- Anomaly detection for machine learning redshifts applied to SDSS galaxies
- Mapping and simulating systematics due to spatially-varying observing conditions in DES Science Verification data
- Data Mining for Gravitationally Lensed Quasars
- Joint Measurement of Lensing-Galaxy Correlations Using SPT and DES SV Data
- Photometric redshifts for the next generation of deep radio continuum surveys - II. Gaussian processes and hybrid estimates
- Cross-correlation of gravitational lensing from DES Science Verification data with SPT and Planck lensing
- A Hybrid Ensemble Learning Approach to Star-Galaxy Classification
- The ALHAMBRA survey: Accurate merger fractions by PDF analysis of photometric close pairs
- Young Galaxy Candidates in the Hubble Frontier Fields. II. MACS,J0416-2403
- A cooperative approach among methods for photometric redshifts estimation: an application to KiDS data
- The Dark Energy Survey 5-year photometrically identified Type Ia Supernovae
- J-PLUS: On the identification of new cluster members in the double galaxy cluster A2589 & A2593 using PDFs
- The MUSE Hubble Ultra Deep Field Survey: III. Testing photometric redshifts to 30th magnitude
- The Overlooked Potential of Generalized Linear Models in Astronomy-II: Gamma regression and photometric redshifts
- Photometric redshifts with machine learning, lights and shadows on a complex data science use case
- Stacking for machine learning redshifts applied to SDSS galaxies
- Galaxy bias from the Dark Energy Survey Science Verification data: combining galaxy density maps and weak lensing maps
- Assessing the photometric redshift precision of the S-PLUS survey: the Stripe-82 as a test-case
- Effect of training characteristics on object classification: an application using Boosted Decision Trees
- Statistical analysis of probability density functions for photometric redshifts through the KiDS-ESO-DR3 galaxies
- Exploring Photometric Redshifts as an Optimization Problem: An Ensemble MCMC and Simulated Annealing-Driven Template-Fitting Approach
- Comparison of Observed Galaxy Properties with Semianalytic Model Predictions using Machine Learning
- The ALHAMBRA survey : band luminosity function of quiescent and star-forming galaxies at by PDF analysis
- PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars
- Hybrid photometric redshifts for sources in the COSMOS and XMM-LSS fields
- Galaxy clustering with photometric surveys using PDF redshift information
- TOPz: Photometric redshifts for J-PAS
- Simulation-based inference of deep fields: galaxy population model and redshift distributions
- PhotoWeb redshift: boosting photometric redshift accuracy with large spectroscopic surveys
- Gaia eclipsing binary and multiple systems. Supervised classification and self-organizing maps
- The ALHAMBRA survey : Estimation of the clustering signal encoded in the cosmic variance
- Machine learning synthetic spectra for probabilistic redshift estimation: SYTH-Z
- TSARDI: a Machine Learning data rejection algorithm for transiting exoplanet light curves
- Data Deluge in Astrophysics: Photometric Redshifts as a Template Use Case
- The many flavours of photometric redshifts
- Rejection criteria based on outliers in the KiDS photometric redshifts and PDF distributions derived by machine learning
- Using gamma regression for photometric redshifts of survey galaxies
- Learn from every mistake! Hierarchical information combination in astronomy
- METAPHOR: Probability density estimation for machine learning based photometric redshifts
- Probability density estimation of photometric redshifts based on machine learning