Mitigating contamination in LSS surveys: a comparison of methods
arXiv:2007.14499 · doi:10.1093/mnras/stab709
Abstract
Future large scale structure surveys will measure the locations and shapes of billions of galaxies. The precision of such catalogs will require meticulous treatment of systematic contamination of the observed fields. We compare several existing methods for removing such systematics from galaxy clustering measurements. We show how all the methods, including the popular pseudo- Mode Projection and Template Subtraction methods, can be interpreted under a common regression framework and use this to suggest improved estimators. We show how methods designed to mitigate systematics in the power spectrum can be used to produce clean maps, which are necessary for cosmological analyses beyond the power spectrum, and we extend current methods to treat the next-order multiplicative contamination in observed maps and power spectra. Two new mitigation methods are proposed, which incorporate desirable features of current state-of-the-art methods while being simpler to implement. Investigating the performance of all the methods on a common set of simulated measurements from Year 5 of the Dark Energy Survey, we test their robustness to various analysis cases. Our proposed methods produce improved maps and power spectra when compared to current methods, while requiring almost no user tuning. We end with recommendations for systematics mitigation in future surveys, and note that the methods presented are generally applicable beyond the galaxy distribution to any field with spatial systematics.
arXiv comment33 pages; Plan of work in Fig 1, key results in Figs. 10-11; Comments welcome
References in corpus (118)
- Scikit-learn: Machine Learning in Python
- The Sloan Digital Sky Survey: Technical Summary
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
- The 2dF Galaxy Redshift Survey: Spectra and redshifts
- The Baryon Oscillation Spectroscopic Survey of SDSS-III
- The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations in the Data Release 10 and 11 galaxy samples
- The 3D power spectrum of galaxies from the SDSS
- The DESI Experiment Part I: Science,Targeting, and Survey Design
- Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
- SparsePak: A Formatted Fiber Field Unit for The WIYN Telescope Bench Spectrograph. I. Design, Construction, and Calibration
- The Hyper Suprime-Cam SSP Survey: Overview and Survey Design
- Cosmology and Fundamental Physics with the Euclid Satellite
- Power Spectrum Analysis of Three-Dimensional Redshift Surveys
- The 2dF Galaxy Redshift Survey: The power spectrum and the matter content of the universe
- Planck 2013 results. XI. All-sky model of thermal dust emission
- MASTER of the CMB Anisotropy Power Spectrum: A Fast Method for Statistical Analysis of Large and Complex CMB Data Sets
- A measurement of the cosmological mass density from clustering in the 2dF Galaxy Redshift Survey
- The 2dF Galaxy Redshift Survey: The bias of galaxies and the density of the Universe
- The WiggleZ Dark Energy Survey: Survey Design and First Data Release
- The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: First measurement of Baryon Acoustic Oscillations between redshift 0.8 and 2.2
- A unified pseudo- framework
- Bayesian physical reconstruction of initial conditions from large scale structure surveys
- The first and second data releases of the Kilo-Degree Survey
- The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Observational systematics and baryon acoustic oscillations in the correlation function
- Analysis of Systematic Effects and Statistical Uncertainties in Angular Clustering of Galaxies from Early SDSS Data
- Cosmology and the Bispectrum
- The power spectrum and bispectrum of SDSS DR11 BOSS galaxies I: bias and gravity
- Ameliorating Systematic Uncertainties in the Angular Clustering of Galaxies: A Study using SDSS-III
- The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Large-scale Structure Catalogs for Cosmological Analysis
- The Bispectrum of IRAS Galaxies
- Counting voids to probe dark energy
- Improving lognormal models for cosmological fields
- The darkness that shaped the void: dark energy and cosmic voids
- Cosmology Constraints from the Weak Lensing Peak Counts and the Power Spectrum in CFHTLenS
- The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations at redshift of 0.72 with the DR14 Luminous Red Galaxy Sample
- ELUCID - Exploring the Local Universe with reConstructed Initial Density field I: Hamiltonian Markov Chain Monte Carlo Method with Particle Mesh Dynamics
- Clustering of Sloan Digital Sky Survey III Photometric Luminous Galaxies: The Measurement, Systematics and Cosmological Implications
- Dark Energy Survey Year 1 Results: Galaxy clustering for combined probes
- The 3D Power Spectrum from Angular Clustering of Galaxies in Early SDSS Data
- ELUCID - Exploring the Local Universe with reConstructed Initial Density field III: Constrained Simulation in the SDSS Volume
- A new approach to observational cosmology using the scattering transform
- Primordial Non-Gaussianity and Analytical Formula for Minkowski Functionals of the Cosmic Microwave Background and Large-scale Structure
- Improved Primordial Non-Gaussianity Constraints from Measurements of Galaxy Clustering and the Integrated Sachs-Wolfe Effect
- Constraints on Galaxy Bias, Matter Density, and Primordial Non--Gausianity from the PSCz Galaxy Redshift Survey
- Probing Cosmology with Weak Lensing Minkowski Functionals
- Statistics of Dark Matter Halos from Gravitational Lensing
- Clustering of quasars in SDSS-IV eBOSS : study of potential systematics and bias determination
- Fast Hamiltonian sampling for large scale structure inference
- Past and present cosmic structure in the SDSS DR7 main sample
- The SDSS-IV extended Baryonic Oscillation Spectroscopic Survey: Luminous Red Galaxy Target Selection
- The Angular Correlation Function of Galaxies from Early SDSS Data
- The Initial Conditions of the Universe from Constrained Simulations
- Emulating the CFHTLenS Weak Lensing data: Cosmological Constraints from moments and Minkowski functionals
- Computing the Three-Point Correlation Function of Galaxies in Time
- The large-scale 3-point correlation function of the SDSS BOSS DR12 CMASS galaxies
- Cosmological Constraints from Multiple Probes in the Dark Energy Survey
- Cosmic shear covariance: The log-normal approximation
- Density split statistics: joint model of counts and lensing in cells
- New Interpretable Statistics for Large Scale Structure Analysis and Generation
- No galaxy left behind: accurate measurements with the faintest objects in the Dark Energy Survey
- A marked correlation function for constraining modified gravity models
- The WiggleZ Dark Energy Survey: constraining galaxy bias and cosmic growth with 3-point correlation functions
- Voids as a Precision Probe of Dark Energy
- Lognormal Property of Weak Lensing Fields
- Galaxy clustering, photometric redshifts and diagnosis of systematics in the DES Science Verification data
- Wide-Field InfraRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA Final Report
- Estimating the large-scale angular power spectrum in the presence of systematics: a case study of Sloan Digital Sky Survey quasars
- The Real Space Correlation Function Measured from the APM Galaxy Survey
- Weak Gravitational Lensing Bispectrum
- Correlations in the Spatial Power Spectrum Inferred from Angular Clustering: Methods and Application to APM
- From Weak Lensing to non-Gaussianity via Minkowski Functionals
- Calibration errors unleashed: effects on cosmological parameters and requirements for large-scale structure surveys
- Mapping and simulating systematics due to spatially-varying observing conditions in DES Science Verification data
- The nature of voids: I. Watershed void finders and their connection with theoretical models
- Exploiting the full potential of photometric quasar surveys: Optimal power spectra through blind mitigation of systematics
- High Resolution Weak Lensing Mass-Mapping Combining Shear and Flexion
- Reconstructing large-scale structure with neutral hydrogen surveys
- Systematic effects in large-scale angular power spectra of photometric quasars and implications for constraining primordial nongaussianity
- The halo-model description of marked statistics
- Improving Galaxy Clustering Measurements with Deep Learning: analysis of the DECaLS DR7 data
- The Angular Power Spectrum of EDSGC Galaxies
- Improving Weak Lensing Mass Map Reconstructions using Gaussian and Sparsity Priors: Application to DES SV
- Sparse component separation for accurate CMB map estimation
- Breaking Halo Occupation Degeneracies with Marked Statistics
- Measuring primordial non-Gaussianity through weak lensing peak counts
- Large Synoptic Survey Telescope: Dark Energy Science Collaboration
- Dark matter voids in the SDSS galaxy survey
- Unbiased methods for removing systematics from galaxy clustering measurements
- What does the Marked Power Spectrum Measure? Insights from Perturbation Theory
- Unbiased pseudo-Cl power spectrum estimation with mode projection
- GLIMPSE: Accurate 3D weak lensing reconstructions using sparsity
- Imaging Systematics and Clustering of DESI Main Targets
- Constraining the initial conditions of the Universe using large scale structure
- Integrated approach to cosmology: Combining CMB, large-scale structure and weak lensing
- The Power Spectrum of Rich Clusters on Near Gigaparsec Scales
- Cross-correlation of WISE Galaxies with the Cosmic Microwave Background
- The SDSS-III Baryonic Oscillation Spectroscopic Survey: Constraints on the Integrated Sachs Wolfe effect
- The SDSS-IV eBOSS: emission line galaxy catalogues at z=0.8 and study of systematic errors in the angular clustering
- A map-based method for eliminating systematic modes from galaxy clustering power spectra with application to BOSS
- Mitigating Systematic Errors in Angular Correlation Function Measurements from Wide Field Surveys
- Inverting the Angular Correlation Function
- Testing LSST Dither Strategies for Survey Uniformity and Large-Scale Structure Systematics
- Power spectrum modelling of galaxy and radio intensity maps including observational effects
- Multiplicative errors in the galaxy power spectrum: self-calibration of unknown photometric systematics for precision cosmology
- Removing Imaging Systematics from Galaxy Clustering Measurements with Obiwan : Application to the SDSS-IV extended Baryon Oscillation Spectroscopic Survey Emission Line Galaxy Sample
- Assessing Galaxy Limiting Magnitudes in Large Optical Surveys
- Explicit Bayesian treatment of unknown foreground contaminations in galaxy surveys
- Sparsity and the Bayesian Perspective
- Characterizing unknown systematics in large scale structure surveys
- Linear Systematics Mitigation in Galaxy Clustering in the Dark Energy Survey Year 1 Data
- Peeling off the late Universe: Reconstructing the ISW map with galaxy surveys
- Dark Energy Survey Year 1 Results: Wide field mass maps via forward fitting in harmonic space
- Integrated Sachs-Wolfe map reconstruction in the presence of systematic errors
- Toward High-Precision Measures of Large-Scale Structure
- Unbiased contaminant removal for 3D galaxy power spectrum measurements
- A Novel CMB Component Separation Method: Hierarchical Generalized Morphological Component Analysis
- Recent Developments in the Analysis of Galaxy Surveys
Cited by in corpus (29)
- Dark Energy Survey Year 3 Results: A 2.7% measurement of Baryon Acoustic Oscillation distance scale at redshift 0.835
- Dark Energy Survey Year 3 results: Cosmological constraints from galaxy clustering and galaxy-galaxy lensing using the MagLim lens sample
- Dark Energy Survey Year 3 Results: Galaxy clustering and systematics treatment for lens galaxy samples
- Dark Energy Survey Year 3 Results: Measuring the Survey Transfer Function with Balrog
- The Atacama Cosmology Telescope: Cosmology from cross-correlations of unWISE galaxies and ACT DR6 CMB lensing
- Primordial non-Gaussianity from the Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey I: Catalogue Preparation and Systematic Mitigation
- Dark Energy Survey: A 2.1% measurement of the angular Baryonic Acoustic Oscillation scale at redshift =0.85 from the final dataset
- Cosmological Constraint Precision of the Photometric and Spectroscopic Multi-probe Surveys of China Space Station Telescope (CSST)
- Determining the Hubble Constant without the Sound Horizon: Perspectives with Future Galaxy Surveys
- Angular clustering properties of the DESI QSO target selection using DR9 Legacy Imaging Surveys
- Cross-Correlation of Planck CMB Lensing with DESI-Like LRGs
- Local primordial non-Gaussianity from the large-scale clustering of photometric DESI luminous red galaxies
- Organised Randoms: Learning and correcting for systematic galaxy clustering patterns in KiDS using self-organising maps
- Consistency of cosmic shear analyses in harmonic and real space
- Linear Systematics Mitigation in Galaxy Clustering in the Dark Energy Survey Year 1 Data
- The Impact of Anisotropic Redshift Distributions on Angular Clustering
- Dark Energy Survey: Galaxy Sample for the Baryonic Acoustic Oscillation Measurement from the Final Dataset
- Emission-line Stacking of 21cm Intensity Maps with MeerKLASS: Inference Pipeline and Application to the L-band Deep-field Data
- KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects
- Self-calibrating optical galaxy cluster selection bias using cluster, galaxy, and shear cross-correlations
- Cosmology at high redshift -- a probe of fundamental physics
- On the impact of the galaxy window function on cosmological parameter estimation
- Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements
- Constraints on primordial non-Gaussianity from Quaia
- Spurious correlations between galaxies and multi-epoch image stacks in the DESI Legacy Surveys
- Separating Angular and Radial Modes with Spherical-Fourier Bessel Power Spectrum on All Scales and Implications for Systematics Mitigation
- Dark Energy Survey Year 3 Results: Galaxy Sample for BAO Measurement
- Simultaneous Estimation of Large-Scale Structure and Milky Way Dust Extinction from Galaxy Surveys
- Systematics mitigation for catalogue-based angular power spectra