DeepGraviLens: a Multi-Modal Architecture for Classifying Gravitational Lensing Data

Abstract

Gravitational lensing is the relativistic effect generated by massive bodies, which bend the space-time surrounding them. It is a deeply investigated topic in astrophysics and allows validating theoretical relativistic results and studying faint astrophysical objects that would not be visible otherwise. In recent years Machine Learning methods have been applied to support the analysis of the gravitational lensing phenomena by detecting lensing effects in data sets consisting of images associated with brightness variation time series. However, the state-of-art approaches either consider only images and neglect time-series data or achieve relatively low accuracy on the most difficult data sets. This paper introduces DeepGraviLens, a novel multi-modal network that classifies spatio-temporal data belonging to one non-lensed system type and three lensed system types. It surpasses the current state of the art accuracy results by $\approx 3\%$ to $\approx 11\%$, depending on the considered data set. Such an improvement will enable the acceleration of the analysis of lensed objects in upcoming astrophysical surveys, which will exploit the petabytes of data collected, e.g., from the Vera C. Rubin Observatory.

arXiv commentThis preprint has not undergone peer review or any post-submission improvements or corrections. The Version of Record of this article is published in Neural Computing and Applications, and is available online at https://doi.org/10.1007/s00521-023-08766-9

References in corpus (39)

• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The Dark Energy Camera
• The Dark Energy Survey Data Release 1
• Strong Lensing by Galaxies
• First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: Constraints on Cosmological Parameters
• lenstronomy II: A gravitational lensing software ecosystem
• Maximum Brightness and Post-Maximum Decline of Light Curves of SN~Ia: A Comparison of Theory and Observations
• Finding Strong Gravitational Lenses in the Kilo Degree Survey with Convolutional Neural Networks
• Strong gravitational lensing of explosive transients
• The Ultraviolet Spectrum of the Gravitationally Lensed Galaxy `The Cosmic Horseshoe': A Close-up of a Star-forming Galaxy at z = 2
• Strong gravitational lensing by wormholes
• LinKS: Discovering galaxy-scale strong lenses in the Kilo-Degree Survey using Convolutional Neural Networks
• Strong gravitational lensing by rotating Simpson--Visser black holes
• Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessment
• Deep Convolutional Neural Networks as strong gravitational lens detectors
• Automated detection of galaxy-scale gravitational lenses in high resolution imaging data
• Strong gravitational lensing of a 4-dimensional Einstein-Gauss-Bonnet black hole in homogeneous plasma
• Identifying Strong Lenses with Unsupervised Machine Learning using Convolutional Autoencoder
• HOLISMOKES -- II. Identifying galaxy-scale strong gravitational lenses in Pan-STARRS using convolutional neural networks
• How to Find Gravitationally Lensed Type Ia Supernovae
• New high-quality strong lens candidates with deep learning in the Kilo Degree Survey
• LensExtractor: A Convolutional Neural Network in Search of Strong Gravitational Lenses
• Magnified or multiply imaged? - Search strategies for gravitationally lensed supernovae in wide-field surveys
• Using Convolutional Neural Networks to identify Gravitational Lenses in Astronomical images
• Gaia GraL: Gaia DR2 Gravitational Lens Systems. III. A systematic blind search for new lensed systems
• How to select and use tools? : Active Perception of Target Objects Using Multimodal Deep Learning
• KiDS-SQuaD II: Machine learning selection of bright extragalactic objects to search for new gravitationally lensed quasars
• Survey of Gravitationally-lensed Objects in HSC Imaging (SuGOHI). IV. Lensed quasar search in the HSC survey
• Gaia GraL: Gaia DR2 Gravitational Lens Systems. VI. Spectroscopic Confirmation and Modeling of Quadruply-Imaged Lensed Quasars
• Support Vector Machine classification of strong gravitational lenses
• Strong lensing in UNIONS: Toward a pipeline from discovery to modeling
• Observational determination of the time delays in gravitational lens system Q2237+030
• Comparison of Multi-Class and Binary Classification Machine Learning Models in Identifying Strong Gravitational Lenses
• DeepZipper: A Novel Deep Learning Architecture for Lensed Supernovae Identification
• Lensed quasar search via time variability with the HSC transient survey
• deeplenstronomy: A dataset simulation package for strong gravitational lensing
• Controlling for Confounders in Multimodal Emotion Classification via Adversarial Learning
• AI-driven spatio-temporal engine for finding gravitationally lensed type Ia supernovae
• Statistical characterization and classification of astronomical transients with Machine Learning in the era of the Vera C. Rubin Observatory

Cited by in corpus (4)

• Deep learning-based astronomical multimodal data fusion: A comprehensive review
• The hunt for new pulsating ultraluminous X-ray sources: a clustering approach
• DeepRed: an architecture for redshift estimation
• Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sources