Photometric redshifts with machine learning, lights and shadows on a complex data science use case
arXiv:2104.06774 · doi:10.3389/fspas.2021.658229
Abstract
The current role of data-driven science is constantly increasing its importance within Astrophysics, due to the huge amount of multi-wavelength data collected every day, characterized by complex and high-volume information requiring efficient and as much as possible automated exploration tools. Furthermore, to accomplish main and legacy science objectives of future or incoming large and deep survey projects, such as JWST, LSST and Euclid, a crucial role is played by an accurate estimation of photometric redshifts, whose knowledge would permit the detection and analysis of extended and peculiar sources by disentangling low-z from high-z sources and would contribute to solve the modern cosmological discrepancies. The recent photometric redshift data challenges, organized within several survey projects, like LSST and Euclid, pushed the exploitation of multi-wavelength and multi-dimensional data observed or ad hoc simulated to improve and optimize the photometric redshifts prediction and statistical characterization based on both SED template fitting and machine learning methodologies. But they also provided a new impetus in the investigation on hybrid and deep learning techniques, aimed at conjugating the positive peculiarities of different methodologies, thus optimizing the estimation accuracy and maximizing the photometric range coverage, particularly important in the high-z regime, where the spectroscopic ground truth is poorly available. In such a context we summarize what learned and proposed in more than a decade of research.
Preprint version of the manuscript to appear in the Volume: "The Physical Challenges of Astrostatistics", special issue of "Frontiers in Astronomy and Space Sciences"
References in corpus (38)
- The UKIRT Infrared Deep Sky Survey (UKIDSS)
- The Cosmic Evolution Survey (COSMOS) -- Overview
- EAZY: A Fast, Public Photometric Redshift Code
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- eROSITA Science Book: Mapping the Structure of the Energetic Universe
- Photometric redshift and classification for the XMM-COSMOS sources
- Dark matter halo properties of GAMA galaxy groups from 100 square degrees of KiDS weak lensing data
- Photometric redshift estimation via deep learning
- Precision photometric redshift calibration for galaxy-galaxy weak lensing
- Machine Learning in Astronomy: a practical overview
- Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
- The weirdest SDSS galaxies: results from an outlier detection algorithm
- Wide-Field InfraRed Survey Telescope (WFIRST) Final Report
- MUSE integral-field spectroscopy towards the Frontier Fields Cluster Abell S1063: I. Data products and redshift identifications
- Photometric redshifts for the next generation of deep radio continuum surveys - I: Template fitting
- METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
- The-wiZZ: Clustering redshift estimation for everyone
- Photometric Redshifts with the LSST: Evaluating Survey Observing Strategies
- AGN Populations in Large Volume X-ray Surveys: Photometric Redshifts and Population Types found in the Stripe 82X Survey
- A catalogue of photometric redshifts for the SDSS-DR9 galaxies
- Star formation rates and stellar masses from machine learning
- Automated physical classification in the SDSS DR10. A catalogue of candidate Quasars
- Mining the SDSS archive. I. Photometric redshifts in the nearby universe
- What Lies Beneath: Using p(z) to Reduce Systematic Photometric Redshift Errors
- A machine learning approach to galaxy properties: joint redshift-stellar mass probability distributions with Random Forest
- A cooperative approach among methods for photometric redshifts estimation: an application to KiDS data
- Photometric redshifts with Quasi Newton Algorithm (MLPQNA). Results in the PHAT1 contest
- Star Formation Rates for photometric samples of galaxies using machine learning methods
- Data-driven, interpretable photometric redshifts trained on heterogeneous and unrepresentative data
- Weighing the Universe with Photometric Redshift Surveys and the Impact on Dark Energy Forecasts
- Simulating JWST deep extragalactic imaging surveys and physical parameter recovery
- Improving the reliability of photometric redshift with machine learning
- Characterizing and Propagating Modeling Uncertainties in Photometrically-Derived Redshift Distributions
- The PAU Survey: narrowband photometric redshifts using Gaussian processes
- QSO photometric redshifts from SDSS, WISE and GALEX colours
- Nature versus nurture: relic nature and environment of the most massive passive galaxies at
- Photometric Redshifts and Photometry Errors
- Photometric Redshift Analysis using Supervised Learning Algorithms and Deep Learning