The impact of human expert visual inspection on the discovery of strong gravitational lenses

Abstract

We investigate the ability of human 'expert' classifiers to identify strong gravitational lens candidates in Dark Energy Survey like imaging. We recruited a total of 55 people that completed more than 25$\%$ of the project. During the classification task, we present to the participants 1489 images. The sample contains a variety of data including lens simulations, real lenses, non-lens examples, and unlabeled data. We find that experts are extremely good at finding bright, well-resolved Einstein rings, whilst arcs with $g$-band signal-to-noise less than $\sim$25 or Einstein radii less than $\sim$1.2 times the seeing are rarely recovered. Very few non-lenses are scored highly. There is substantial variation in the performance of individual classifiers, but they do not appear to depend on the classifier's experience, confidence or academic position. These variations can be mitigated with a team of 6 or more independent classifiers. Our results give confidence that humans are a reliable pruning step for lens candidates, providing pure and quantifiably complete samples for follow-up studies.

arXiv comment16 pages, 20 Figures

References in corpus (33)

• H0LiCOW XIII. A 2.4% measurement of $H_0$ from lensed quasars: $5.3\sigma$ tension between early and late-Universe probes
• The Hyper Suprime-Cam SSP Survey: Overview and Survey Design
• The Dark Energy Camera
• The COSMOS Survey: Hubble Space Telescope / Advanced Camera for Surveys (HST/ACS) Observations and Data Processing
• COSMOS : Hubble Space Telescope Observations
• H0LiCOW V. New COSMOGRAIL time delays of HE0435-1223: $H_0$ to 3.8% precision from strong lensing in a flat $\Lambda$CDM model
• Weak Gravitational Lensing with COSMOS: Galaxy Selection and Shape Measurements
• The population of galaxy-galaxy strong lenses in forthcoming optical imaging surveys
• Lenstronomy: multi-purpose gravitational lens modelling software package
• Detection of a Dark Substructure through Gravitational Imaging
• The Sloan Lens ACS Survey. IX. Colors, Lensing and Stellar Masses of Early-type Galaxies
• Spectroscopic detection of CIV in a galaxy at z=7.045: Implications for the ionizing spectra of reionization-era galaxies
• CMU DeepLens: Deep Learning For Automatic Image-based Galaxy-Galaxy Strong Lens Finding
• lenstronomy II: A gravitational lensing software ecosystem
• Finding Strong Gravitational Lenses in the Kilo Degree Survey with Convolutional Neural Networks
• Cosmological Constraints from the double source plane lens SDSSJ0946+1006
• Finding strong lenses in CFHTLS using convolutional neural networks
• Gravitationally Lensed Galaxies at 2<z<3.5: Direct Abundance Measurements of Lya Emitters
• Space Warps: I. Crowd-sourcing the Discovery of Gravitational Lenses
• LinKS: Discovering galaxy-scale strong lenses in the Kilo-Degree Survey using Convolutional Neural Networks
• Survey of Gravitationally-lensed Objects in HSC Imaging (SuGOHI). I. Automatic search for galaxy-scale strong lenses
• Finding high-redshift strong lenses in DES using convolutional neural networks
• The BOSS Emission-Line Lens Survey. IV. : Smooth Lens Models for the BELLS GALLERY Sample
• Probing dark matter substructure in the gravitational lens HE0435-1223 with the WFC3 grism
• HOLISMOKES -- II. Identifying galaxy-scale strong gravitational lenses in Pan-STARRS using convolutional neural networks
• Strong Gravitational Lensing Time Delay Statistics and the Density Profile of Dark Halos
• Strong lens systems search in the Dark Energy Survey using Convolutional Neural Networks
• TDCOSMO III: Dark matter substructure meets dark energy -- the effects of (sub)halos on strong-lensing measurements of $H_0$
• Strong lensing in UNIONS: Toward a pipeline from discovery to modeling
• Lensing Probabilities for Spectroscopically Selected Galaxy-Galaxy Strong Lenses
• A census of optically dark massive galaxies in the early Universe from magnification by lensing galaxy clusters
• Thirty-fold: Extreme gravitational lensing of a quiescent galaxy at $z=1.6$
• Automated Lensing Learner: Automated Strong Lensing Identification with a Computer Vision Technique

Cited by in corpus (12)

• New Strong Gravitational Lenses from the DESI Legacy Imaging Surveys Data Release 9
• Euclid: The Early Release Observations Lens Search Experiment
• HOLISMOKES -- XI. Evaluation of supervised neural networks for strong-lens searches in ground-based imaging surveys
• TEGLIE: Transformer encoders as strong gravitational lens finders in KiDS
• A Bayesian Approach to Strong Lens Finding in the Era of Wide-area Surveys
• HOLISMOKES XIII: Strong-lens candidates at all mass scales and their environments from the Hyper-Suprime Cam and deep learning
• Anisotropic strong lensing as a probe of dark matter self-interactions
• The COSMOS-Web Lens Survey (COWLS) III: forecasts versus data
• HOLISMOKES XVI: Lens search in HSC-PDR3 with a neural network committee and post-processing for false-positive removal
• Searching for strong lensing by late-type galaxies in UNIONS
• COOL-LAMPS. VII. Quantifying Strong-lens Scaling Relations with 177 Cluster-scale Strong Gravitational Lenses in DECaLS
• Most Strong Lensing Deflectors in the AGEL Survey Are in Group and Cluster Environments