GREAT3 results I: systematic errors in shear estimation and the impact of real galaxy morphology

Abstract

We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically-varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially-varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by $\sim 1$ per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

arXiv comment32 pages + 15 pages of technical appendices; 28 figures; published in MNRAS; all data and other information may be found at https://github.com/barnabytprowe/great3-public as the GREAT3 website and leaderboard are no longer live. v3 has updates to this comment only

References in corpus (69)

• emcee: The MCMC Hammer
• Weak Gravitational Lensing
• The Cosmic Evolution Survey (COSMOS) -- Overview
• A Method for Weak Lensing Observations
• The COSMOS Survey: Hubble Space Telescope / Advanced Camera for Surveys (HST/ACS) Observations and Data Processing
• CFHTLenS tomographic weak lensing cosmological parameter constraints: Mitigating the impact of intrinsic galaxy alignments
• Shapes and Shears, Stars and Smears: Optimal Measurements for Weak Lensing
• The Shear TEsting Programme 1: Weak lensing analysis of simulated ground-based observations
• COSMOS : Hubble Space Telescope Observations
• Weak Gravitational Lensing by Large-Scale Structure
• Bayesian Galaxy Shape Measurement for Weak Lensing Surveys - III. Application to the Canada-France-Hawaii Telescope Lensing Survey
• Weak Gravitational Lensing and its Cosmological Applications
• A discriminating probe of gravity at cosmological scales
• The Shear TEsting Programme 2: Factors affecting high precision weak lensing analyses
• A new measure for cosmic shear
• Shear calibration biases in weak lensing surveys
• The Mass Assembly Histories of Galaxies of Various Morphologies in the GOODS Fields
• Detection of weak lensing by a cluster of galaxies at z=0.83
• Systematic errors in weak lensing: application to SDSS galaxy-galaxy weak lensing
• The dark matter of gravitational lensing
• Weak Lensing and Dark Energy
• Dark Synergy: Gravitational Lensing and the CMB
• Hubble Space Telescope weak lensing study of the z=0.83 cluster MS 1054-03
• Origins of weak lensing systematics, and requirements on future instrumentation (or knowledge of instrumentation)
• A New Shear Estimator for Weak Lensing Observations
• Galaxy-galaxy weak lensing in SDSS: intrinsic alignments and shear calibration errors
• Weak Lensing Measurements: A Revisited Method and Application to HST Images
• Image Analysis for Cosmology: Results from the GREAT10 Galaxy Challenge
• Noise bias in weak lensing shape measurements
• The Third Gravitational Lensing Accuracy Testing (GREAT3) Challenge Handbook
• Results of the GREAT08 Challenge: An image analysis competition for cosmological lensing
• Weak Gravitational Lensing
• Optical-to-virial velocity ratios of local disk galaxies from combined kinematics and galaxy-galaxy lensing
• Astrophysically Motivated Bulge-Disk Decompositions of SDSS Galaxies
• Cosmic shear results from the deep lens survey - I: Joint constraints on omega_m and sigma_8 with a two-dimensional analysis
• Means of confusion: how pixel noise affects shear estimates for weak gravitational lensing
• Neutrino Mass and Dark Energy from Weak Lensing
• Handbook for the GREAT08 Challenge: An image analysis competition for cosmological lensing
• Defining a weak lensing experiment in space
• Combining Undersampled Dithered Images
• IM3SHAPE: A maximum-likelihood galaxy shear measurement code for cosmic gravitational lensing
• SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
• Shape measurement biases from underfitting and ellipticity gradients
• Measurement and Calibration of Noise Bias in Weak Lensing Galaxy Shape Estimation
• Bayesian Lensing Shear Measurement
• Precision simulation of ground-based lensing data using observations from space
• Weak Lensing Mass Reconstruction using Wavelets
• An Implementation of Bayesian Lensing Shear Measurement
• Weak gravitational shear and flexion with polar shapelets
• Accurate Shear Measurement with Faint Sources
• Weak gravitational lensing with DEIMOS
• Image Analysis for Cosmology: Results from the GREAT10 Star Challenge
• Gravitational Lensing Accuracy Testing 2010 (GREAT10) Challenge Handbook
• Limitations for shapelet-based weak-lensing measurements
• Optimal Linear Image Combination
• Measuring the Cosmic Shear in Fourier Space
• Cosmic Shears Should Not Be Measured In Conventional Ways
• Replacing standard galaxy profiles with mixtures of Gaussians
• Sérsic galaxy models in weak lensing shape measurement: model bias, noise bias and their interaction
• Generic Misalignment Aberration Patterns in Wide-Field Telescopes
• A New Method for Band-limited Imaging with Undersampled Detectors
• Measuring the Reduced Shear
• Simple Treatments of the Photon Noise and the Pixelation Effect in Weak Lensing
• Elliptical Weighted HOLICs for Weak Lensing Shear Measurement part2:PSF correction and application to Abell 370
• A fast empirical method for galaxy shape measurements in weak lensing surveys
• Pixelation Effects in Weak Lensing
• Elliptical Weighted HOLICs for Weak Lensing Shear Measurement. part1:Definitions and isotropic PSF correction
• Elliptical Weighted HOLICs for Weak Lensing Shear Measurement part3:Random Count Noise Effect for Image's Moments in Weak Lensing Analysis
• On the effect of image denoising on galaxy shape measurements

Cited by in corpus (128)

• KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
• Euclid. I. Overview of the Euclid mission
• The Canadian Cluster Comparison Project: detailed study of systematics and updated weak lensing masses
• Weak lensing for precision cosmology
• Galaxy alignments: An overview
• The galaxy cluster mass scale and its impact on cosmological constraints from the cluster population
• The first-year shear catalog of the Subaru Hyper Suprime-Cam SSP Survey
• Dark Energy Survey Year 1 Results: Weak Lensing Shape Catalogues
• The DES Science Verification Weak Lensing Shear Catalogues
• Galaxy alignments: Observations and impact on cosmology
• DES Y3 + KiDS-1000: Consistent cosmology combining cosmic shear surveys
• Weak lensing shear calibration with simulations of the HSC survey
• Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
• Calibration of weak-lensing shear in the Kilo-Degree Survey
• Cluster-galaxy weak lensing
• Pan-STARRS Pixel Analysis : Source Detection and Characterization
• DES Y3 results: Blending shear and redshift biases in image simulations
• KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics-I: Inference from Analytical Prediction of High Signal-to-Noise Ratio Convergence Peaks
• Cosmic Shear Results from the Deep Lens Survey - II: Full Cosmological Parameter Constraints from Tomography
• Towards emulating cosmic shear data: Revisiting the calibration of the shear measurements for the Kilo-Degree Survey
• Looking through the same lens: shear calibration for LSST, Euclid & WFIRST with stage 4 CMB lensing
• A study of the sensitivity of shape measurements to the input parameters of weak lensing image simulations
• Source Selection for Cluster Weak Lensing Measurements in the Hyper Suprime-Cam Survey
• Two- and three-dimensional wide-field weak lensing mass maps from the Hyper Suprime-Cam Subaru Strategic Program S16A data
• An accurate and practical method for inference of weak gravitational lensing from galaxy images
• Euclid Preparation IV. Impact of undetected galaxies on weak-lensing shear measurements
• Intrinsic alignments of BOSS LOWZ galaxies II: Impact of shape measurement methods
• Planck Sunyaev-Zel'dovich Cluster Mass Calibration using Hyper Suprime-Cam Weak Lensing
• Dark Energy Survey Year 1 Results: The Impact of Galaxy Neighbours on Weak Lensing Cosmology with im3shape
• A Unified Analysis of Four Cosmic Shear Surveys
• The Ellipticity Distribution of Ambiguously Blended Objects
• Evidence for radial variations in the stellar mass-to-light ratio of massive galaxies from weak and strong lensing
• Deep Learning for space-variant deconvolution in galaxy surveys
• Deep Generative Models for Galaxy Image Simulations
• Unveiling the Intrinsic Alignment of Galaxies with Self-Calibration and DECaLS DR3 data
• The Richness-to-Mass Relation of CAMIRA Galaxy Clusters from Weak-lensing Magnification in the Subaru Hyper Suprime-Cam Survey
• SKA Weak Lensing II: Simulated Performance and Survey Design Considerations
• MC${}^2$: Subaru and Hubble Space Telescope Weak-Lensing Analysis of the Double Radio Relic Galaxy Cluster PLCK G287.0+32.9
• KiDS-Legacy calibration: unifying shear and redshift calibration with the SKiLLS multi-band image simulations
• Calibrated Ultra Fast Image Simulations for the Dark Energy Survey
• Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies
• MC^2: Mapping the Dark Matter Distribution of the "Toothbrush" Cluster RX J0603.3+4214 with Hubble Space Telescope and Subaru Weak-lensing
• Approaching the Cramer-Rao Bound in Weak Lensing with PDF Symmetrization
• Detection of Enhancement in Number Densities of Background Galaxies due to Magnification by Massive Galaxy Clusters
• Weak-lensing shear measurement with machine learning: teaching artificial neural networks about feature noise
• Testing Shear Recovery with Field Distortion
• CLUMP-3D: Three-dimensional Shape and Structure of 20 CLASH Galaxy Clusters from Combined Weak and Strong Lensing
• Exemplary Merging Clusters: Weak-lensing and X-ray Analysis of the Double Radio Relic Merging Galaxy Clusters MACS 1752.0+4440 and ZWCL 1856.8+6616
• Constraining the masses of high-redshift clusters with weak lensing: Revised shape calibration testing for the impact of stronger shears and increased blending
• A highly precise shear bias estimator independent of the measured shape noise
• Non-Gaussianity in the Weak Lensing Correlation Function Likelihood -- Implications for Cosmological Parameter Biases
• The dependence of intrinsic alignment of galaxies on wavelength using KiDS and GAMA
• First measurement of the characteristic depletion radius of dark matter haloes from weak lensing
• The Impact of Interpixel Capacitance in CMOS Detectors on PSF shapes and Implications for WFIRST
• Halo Properties and Mass Functions of Groups/Clusters from the DESI Legacy Imaging Surveys DR9
• Constraints on Cosmology and Baryonic Feedback with the Deep Lens Survey Using Galaxy-Galaxy and Galaxy-Mass Power Spectra
• Weak-Lensing Detection of Intracluster Filaments in the Coma Cluster
• Multi-wavelength Analysis of the Merging Galaxy Cluster A115
• Generalized shear-ratio tests: A new relation between cosmological distances, and a diagnostic for a redshift-dependent multiplicative bias in shear measurements
• Cosmological Studies from HSC-SSP Tomographic Weak Lensing Peak Abundances
• The effect of detector nonlinearity on WFIRST PSF profiles for weak gravitational lensing measurements
• Testing PSF Interpolation In Weak Lensing With Real Data
• Euclid: Nonparametric point spread function field recovery through interpolation on a graph Laplacian
• Mitigating the effects of undersampling in weak lensing shear estimation with metacalibration
• Galaxy shape measurement with convolutional neural networks
• Accounting for object detection bias in weak gravitational lensing studies
• Galaxy-Galaxy Weak Lensing Measurements from SDSS: I. Image Processing and Lensing signals
• The correlation of extragalactic $\gamma$-rays with cosmic matter density distributions from weak-gravitational lensing
• Constraining the Mass of the Emerging Galaxy Cluster SpARCS1049+56 at z=1.71 with Infrared Weak Lensing
• CODEX Weak Lensing Mass Catalogue and implications on the mass-richness relation
• SuperCLASS -- III. Weak lensing from radio and optical observations in Data Release 1
• Towards a Bias-Free Selection Function in Shear Measurement
• Instrumental systematics and weak gravitational lensing
• Weak lensing shear estimation beyond the shape-noise limit: a machine learning approach
• Multiwavelength study of X-ray Luminous Clusters in the Hyper Suprime-Cam Subaru Strategic Program S16A field
• An empirical approach to model selection: weak lensing and intrinsic alignments
• The First Weak-lensing Analysis with the James Webb Space Telescope: SMACS J0723.3-7327
• Weak lensing power spectrum reconstruction by counting galaxies.-- I: the ABS method
• Weak Gravitational Lensing Shear Estimation with Metacalibration for the Roman High-Latitude Imaging Survey
• Precise Mass Determination of SPT-CL J2106-5844, the Most Massive Cluster at z>1
• Toward Solving the Puzzle: Dissecting the Complex Merger A521 with Multi-wavelength Data
• Non-negative matrix factorization for self-calibration of photometric redshift scatter in weak lensing surveys
• Radio Weak Lensing Shear Measurement in the Visibility Domain - I. Methodology
• Euclid preparation. LIII. LensMC, weak lensing cosmic shear measurement with forward modelling and Markov Chain Monte Carlo sampling
• The SRG/eROSITA All-Sky Survey : Subaru/HSC-SSP weak-lensing mass measurements for the eRASS1 Galaxy Clusters
• Hubble Frontier Field Clusters and their Parallel Fields: Photometric and Photometric Redshift Catalogs
• Testing the Impact of Satellite Anisotropy on Large and Small Scale Intrinsic Alignments using Hydrodynamical Simulations
• RCSLenS: A new estimator for large-scale galaxy-matter correlations
• KiDS+VIKING-450: An internal-consistency test for cosmic shear tomography with a colour-based split of source galaxies
• An accurate centroid algorithm for PSF reconstruction
• Weak-lensing Mass Reconstruction of Galaxy Clusters with Convolutional Neural Network
• Avoiding the Geometric Boundary Effect in Shear Measurement
• Shear measurement bias I: dependencies on methods, simulation parameters and measured parameters
• The impact of correlated noise on galaxy shape estimation for weak lensing
• Radio Galaxy Shape Measurement with Hamiltonian Monte Carlo in the Visibility Domain
• Dark Energy Survey Year 6 Results: Cell-based Coadds and Metadetection Weak Lensing Shape Catalogue
• Forecast of cross-correlation of CSST cosmic shear tomography with AliCPT-1 CMB lensing
• Shear Nulling after PSF Gaussianisation: moment-based weak lensing measurements with subpercent noise bias
• Weak Lensing Study in VOICE Survey II: Shear Bias Calibrations
• Cosmic shear measurement with maximum likelihood and maximum a posteriori inference
• Simulating image coaddition with the Nancy Grace Roman Space Telescope: II. Analysis of the simulated images and implications for weak lensing
• CLMM: a LSST-DESC Cluster weak Lensing Mass Modeling library for cosmology
• Optimising LSST Observing Strategy for Weak Lensing Systematics
• Probabilistic Cosmological Mass Mapping from Weak Lensing Shear
• De-noising the galaxies in the Hubble XDF with EMPCA
• Diagnosing multiplicative error by lensing magnification of type Ia supernovae
• The Effects of Calibration on the Bias of Shear Measurements
• A Framework for Measuring Weak-Lensing Magnification Using the Fundamental Plane
• A demonstration of position angle-only weak lensing shear estimators on the GREAT3 simulations
• CHEX-MATE: Multi-probe analysis of Abell 1689
• Galaxy Image Deconvolution for Weak Gravitational Lensing with Unrolled Plug-and-Play ADMM
• Euclid preparation. LXVII. Deep learning true galaxy morphologies for weak lensing shear bias calibration
• UFig v1: The ultra-fast image generator
• Synthetic Galaxy Clusters and Observations Based on Dark Energy Survey Year 3 Data
• Radio emission from a massive node of the cosmic web. A discovery powered by machine learning
• The mass distribution in an assembling super galaxy group at $z=0.37$
• Conference summary: Workshop on Precision Astronomy with Fully Depleted CCDs (2014)
• Weak Lensing Reconstruction by Counting DECaLS Galaxies
• Deep lensing with a twist: E and B modes in a field with multiple lenses
• Removing the Impact of Correlated PSF Uncertainties in Weak Lensing
• Chasing the peak: optimal statistics for weak shear analyses
• Shear measurement bias II: a fast machine learning calibration method
• Impact of PSF misestimation and galaxy population bias on precision shear measurement using a CNN
• AMICO galaxy clusters in KiDS-DR3: the impact of estimator statistics on the luminosity-mass scaling relation
• Impact of Point Spread Function Higher Moments Error on Weak Gravitational Lensing
• RadioLensfit: an HPC Tool for Accurate Galaxy Shape Measurement with SKA
• Euclid: Early Release Observations. Weak gravitational lensing analysis of Abell 2390
• Biased Moments of Undersampled Sources