Improved Weak Lensing Photometric Redshift Calibration via StratLearn and Hierarchical Modeling

Abstract

Discrepancies between cosmological parameter estimates from cosmic shear surveys and from recent Planck cosmic microwave background measurements challenge the ability of the highly successful $\Lambda$CDM model to describe the nature of the Universe. To rule out systematic biases in cosmic shear survey analyses, accurate redshift calibration within tomographic bins is key. In this paper, we improve photo-$z$ calibration via Bayesian hierarchical modeling of full galaxy photo-$z$ conditional densities, by employing $\text{StratLearn}$, a recently developed statistical methodology, which accounts for systematic differences in the distribution of the spectroscopic training/source set and the photometric target set. Using realistic simulations that were designed to resemble the KiDS+VIKING-450 dataset, we show that $\text{StratLearn}$-estimated conditional densities improve the galaxy tomographic bin assignment, and that our $\text{StratLearn}$-Bayesian framework leads to nearly unbiased estimates of the target population means. This leads to a factor of $\sim 2$ improvement upon the previously best photo-$z$ calibration method. Our approach delivers a maximum bias per tomographic bin of $\Delta ⟨z⟩=0.0095\pm 0.0089$, with an average absolute bias of $0.0052\pm 0.0067$ across the five tomographic bins.

arXiv comment24 pages, 20 figures, 3 appendices

References in corpus (53)

• Planck 2018 results. I. Overview and the cosmological legacy of Planck
• Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Bayesian photometric redshift estimation
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• CFHTLenS: The Canada-France-Hawaii Telescope Lensing Survey
• Dark Energy Survey Year 1 Results: Cosmological Constraints from Cosmic Shear
• Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
• Power Spectrum Tomography with Weak Lensing
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Modeling Uncertainty
• KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
• Photometric Redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1
• The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
• CFHTLenS: Improving the quality of photometric redshifts with precision photometry
• Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
• Cosmological constraints from cosmic shear two-point correlation functions with HSC survey first-year data
• PHAT: PHoto-z Accuracy Testing
• The MICE Grand Challenge Lightcone Simulation I: Dark matter clustering
• Estimating the Redshift Distribution of Faint Galaxy Samples
• Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
• Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
• The MICE Grand Challenge Lightcone Simulation II: Halo and Galaxy catalogues
• Systematic Bias in Cosmic Shear: Beyond the Fisher Matrix
• Dark Energy Survey Year 3 Results: Redshift Calibration of the Weak Lensing Source Galaxies
• An algorithm to build mock galaxy catalogues using MICE simulations
• KiDS+VIKING-450 and DES-Y1 combined: Cosmology with cosmic shear
• DES Y3 + KiDS-1000: Consistent cosmology combining cosmic shear surveys
• DNF - Galaxy photometric redshift by Directional Neighbourhood Fitting
• On using angular cross-correlations to determine source redshift distributions
• Photometric Redshift Calibration with Self Organising Maps
• KiDS+VIKING-450: A new combined optical & near-IR dataset for cosmology and astrophysics
• Photometric Redshifts for Next-Generation Surveys
• Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
• Survey geometry and the internal consistency of recent cosmic shear measurements
• Spectroscopic Needs for Imaging Dark Energy Experiments: Photometric Redshift Training and Calibration
• Using Galaxy Two-point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift
• RCSLenS: The Red Cluster Sequence Lensing Survey
• Dark Energy Survey Year 3 Results: Clustering Redshifts -- Calibration of the Weak Lensing Source Redshift Distributions with redMaGiC and BOSS/eBOSS
• Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts - Methods and Systematics Characterization
• Measuring the growth of matter fluctuations with third-order galaxy correlations
• The-wiZZ: Clustering redshift estimation for everyone
• Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model
• Testing KiDS cross-correlation redshifts with simulations
• Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
• Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting
• The impact of spectroscopic incompleteness in direct calibration of redshift distributions for weak lensing surveys
• Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model $-$ Application to realistic $N$-body simulations
• Weak Lensing Tomographic Redshift Distribution Inference for the Hyper Suprime-Cam Subaru Strategic Program three-year shape catalogue
• A Unified Framework for Constructing, Tuning and Assessing Photometric Redshift Density Estimates in a Selection Bias Setting
• Bayesian photometric redshifts of blended sources
• Estimating redshift distributions using Hierarchical Logistic Gaussian processes
• Stratified Learning: A General-Purpose Statistical Method for Improved Learning under Covariate Shift
• Propagating photo-$z$ uncertainties: a functional derivative approach

Cited by in corpus (4)

• pop-cosmos: Insights from generative modeling of a deep, infrared-selected galaxy population
• STAR NRE: Solving supernova selection effects with set-based truncated auto-regressive neural ratio estimation
• Reconstructing redshift distributions with photometric galaxy clustering
• FlowSN: Neural Simulation-Based Inference under Realistic Selection Effects applied to Supernova Cosmology