Transformers as Strong Lens Detectors- From Simulation to Surveys

Abstract

With the upcoming large-scale surveys like LSST, we expect to find approximately $10^5$ strong gravitational lenses among data of many orders of magnitude larger. In this scenario, the usage of non-automated techniques is too time-consuming and hence impractical for science. For this reason, machine learning techniques started becoming an alternative to previous methods. In our previous work, we proposed a new machine learning architecture based on the principle of self-attention, trained to find strong gravitational lenses on simulated data from the Bologna Lens Challenge. Self-attention-based models have clear advantages compared to simpler CNNs and highly competing performance in comparison to the current state-of-art CNN models. We apply the proposed model to the Kilo Degree Survey, identifying some new strong lens candidates. However, these have been identified among a plethora of false positives, which made the application of this model not so advantageous. Therefore, throughout this paper, we investigate the pitfalls of this approach, and possible solutions, such as transfer learning, are proposed.

arXiv comment9 pages, 9 figures

References in corpus (50)

• Adam: A Method for Stochastic Optimization
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The Sloan Lens ACS Survey. III - The Structure and Formation of Early-type Galaxies and their Evolution since z~1
• H0LiCOW V. New COSMOGRAIL time delays of HE0435-1223: $H_0$ to 3.8% precision from strong lensing in a flat $\Lambda$CDM model
• Strong Lensing by Galaxies
• Gravitationally lensed quasars and supernovae in future wide-field optical imaging surveys
• The Kilo-Degree Survey
• Gravitational detection of a low-mass dark satellite at cosmological distance
• The population of galaxy-galaxy strong lenses in forthcoming optical imaging surveys
• The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
• Stand-Alone Self-Attention in Vision Models
• CMU DeepLens: Deep Learning For Automatic Image-based Galaxy-Galaxy Strong Lens Finding
• Cosmological Constraints from Strong Gravitational Lensing in Galaxy Clusters
• Finding Strong Gravitational Lenses in the Kilo Degree Survey with Convolutional Neural Networks
• HerMES: Candidate Gravitationally Lensed Galaxies and Lensing Statistics at Submillimeter Wavelengths
• Cosmology with Strong Lensing Systems
• Constraints on Cosmological Parameters from the Analysis of the Cosmic Lens All Sky Survey Radio-Selected Gravitational Lens Statistics
• The Strong Gravitational Lens Finding Challenge
• CLASH-VLT: A Highly Precise Strong Lensing Model of the Galaxy Cluster RXC J2248.7-4431 (Abell S1063) and Prospects for Cosmography
• Cosmological Constraints from the double source plane lens SDSSJ0946+1006
• Finding strong lenses in CFHTLS using convolutional neural networks
• The Emission Line Properties of Gravitationally-lensed 1.5 < z < 5 Galaxies
• Modelling the line-of-sight contribution in substructure lensing
• Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection
• Dark Matter Constraints from a Unified Analysis of Strong Gravitational Lenses and Milky Way Satellite Galaxies
• LinKS: Discovering galaxy-scale strong lenses in the Kilo-Degree Survey using Convolutional Neural Networks
• Finding Strong Gravitational Lenses in the DESI DECam Legacy Survey
• Discovering New Strong Gravitational Lenses in the DESI Legacy Imaging Surveys
• Super-resolving distant galaxies with gravitational telescopes: Keck-LGSAO and Hubble imaging of the lens system SDSSJ0737+3216
• Deep Convolutional Neural Networks as strong gravitational lens detectors
• HOLISMOKES -- II. Identifying galaxy-scale strong gravitational lenses in Pan-STARRS using convolutional neural networks
• New high-quality strong lens candidates with deep learning in the Kilo Degree Survey
• GLAMER Part I: A Code for Gravitational Lensing Simulations with Adaptive Mesh Refinement
• Strong lens systems search in the Dark Energy Survey using Convolutional Neural Networks
• Using Convolutional Neural Networks to identify Gravitational Lenses in Astronomical images
• On the Power Spectrum of Dark Matter Substructure in Strong Gravitational Lenses
• Testing Convolutional Neural Networks for finding strong gravitational lenses in KiDS
• Gravitational Lensing and the Power Spectrum of Dark Matter Substructure: Insights from the ETHOS N-body Simulations
• Deep Learning for Strong Lensing Search: Tests of the Convolutional Neural Networks and New Candidates from KiDS DR3
• Differentiable Strong Lensing: Uniting Gravity and Neural Nets through Differentiable Probabilistic Programming
• North Ecliptic Pole merging galaxy catalogue
• Detecting gravitational lenses using machine learning: exploring interpretability and sensitivity to rare lensing configurations
• Thirty-fold: Extreme gravitational lensing of a quiescent galaxy at $z=1.6$
• Multiband galaxy morphologies for CLASH: a convolutional neural network transferred from CANDELS
• Finding Strong Gravitational Lenses Through Self-Attention
• Gauging the dark matter fraction in a $L_{\ast }$ S0 galaxy at z=0.47 through gravitational lensing from deep HST/ACS imaging
• Strong Lensing considerations for the LSST observing strategy
• Euclid preparation: I. The Euclid Wide Survey
• Strong Lensing Time Delay Constraints on Dark Energy: a Forecast

Cited by in corpus (1)

• TEGLIE: Transformer encoders as strong gravitational lens finders in KiDS