The impact of human expert visual inspection on the discovery of strong gravitational lenses

Abstract

We investigate the ability of human 'expert' classifiers to identify strong gravitational lens candidates in Dark Energy Survey like imaging. We recruited a total of 55 people that completed more than 25$\%$ of the project. During the classification task, we present to the participants 1489 images. The sample contains a variety of data including lens simulations, real lenses, non-lens examples, and unlabeled data. We find that experts are extremely good at finding bright, well-resolved Einstein rings, whilst arcs with $g$-band signal-to-noise less than $\sim$25 or Einstein radii less than $\sim$1.2 times the seeing are rarely recovered. Very few non-lenses are scored highly. There is substantial variation in the performance of individual classifiers, but they do not appear to depend on the classifier's experience, confidence or academic position. These variations can be mitigated with a team of 6 or more independent classifiers. Our results give confidence that humans are a reliable pruning step for lens candidates, providing pure and quantifiably complete samples for follow-up studies.

16 pages, 20 Figures

References in corpus (12)

• H0LiCOW V. New COSMOGRAIL time delays of HE0435-1223: $H_0$ to 3.8% precision from strong lensing in a flat $\Lambda$CDM model
• Weak Gravitational Lensing with COSMOS: Galaxy Selection and Shape Measurements
• lenstronomy II: A gravitational lensing software ecosystem
• Gravitationally Lensed Galaxies at 2<z<3.5: Direct Abundance Measurements of Lya Emitters
• LinKS: Discovering galaxy-scale strong lenses in the Kilo-Degree Survey using Convolutional Neural Networks
• The BOSS Emission-Line Lens Survey. IV. : Smooth Lens Models for the BELLS GALLERY Sample
• HOLISMOKES -- II. Identifying galaxy-scale strong gravitational lenses in Pan-STARRS using convolutional neural networks
• Strong lens systems search in the Dark Energy Survey using Convolutional Neural Networks
• TDCOSMO III: Dark matter substructure meets dark energy -- the effects of (sub)halos on strong-lensing measurements of $H_0$
• Strong lensing in UNIONS: Toward a pipeline from discovery to modeling
• Lensing Probabilities for Spectroscopically Selected Galaxy-Galaxy Strong Lenses
• A census of optically dark massive galaxies in the early Universe from magnification by lensing galaxy clusters

Cited by in corpus (12)

• New Strong Gravitational Lenses from the DESI Legacy Imaging Surveys Data Release 9
• Euclid: The Early Release Observations Lens Search Experiment
• HOLISMOKES -- XI. Evaluation of supervised neural networks for strong-lens searches in ground-based imaging surveys
• TEGLIE: Transformer encoders as strong gravitational lens finders in KiDS
• A Bayesian Approach to Strong Lens Finding in the Era of Wide-area Surveys
• HOLISMOKES XIII: Strong-lens candidates at all mass scales and their environments from the Hyper-Suprime Cam and deep learning
• Anisotropic strong lensing as a probe of dark matter self-interactions
• The COSMOS-Web Lens Survey (COWLS) III: forecasts versus data
• HOLISMOKES XVI: Lens search in HSC-PDR3 with a neural network committee and post-processing for false-positive removal
• Searching for strong lensing by late-type galaxies in UNIONS
• COOL-LAMPS. VII. Quantifying Strong-lens Scaling Relations with 177 Cluster-scale Strong Gravitational Lenses in DECaLS
• Most Strong Lensing Deflectors in the AGEL Survey Are in Group and Cluster Environments