Time-domain deep learning filtering of structured atmospheric noise for ground-based millimeter astronomy
arXiv:2201.06672 · doi:10.3847/1538-4365/ac5259
Abstract
The complex physics involved in atmospheric turbulence makes it very difficult for ground-based astronomy to build accurate scintillation models and develop efficient methodologies to remove this highly structured noise from valuable astronomical observations. We argue that a Deep Learning approach can bring a significant advance to treat this problem because of deep neural networks' inherent ability to abstract non-linear patterns over a broad scale range. We propose an architecture composed of long-short term memory cells and an incremental training strategy inspired by transfer and curriculum learning. We develop a scintillation model and employ an empirical method to generate a vast catalog of atmospheric noise realizations and train the network with representative data. We face two complexity axes: the signal-to-noise ratio (SNR) and the degree of structure in the noise. Hence, we train our recurrent network to recognize simulated astrophysical point-like sources embedded in three structured noise levels, with a raw-data SNR ranging from 3 to 0.1. We find that a slow and repetitive increase in complexity is crucial during training to obtain a robust and stable learning rate that can transfer information through different data contexts. We probe our recurrent model with synthetic observational data, designing alongside a calibration methodology for flux measurements. Furthermore, we implement a traditional matched filtering (MF) to compare its performance with our neural network, finding that our final trained network can successfully clean structured noise and significantly enhance the SNR compared to raw data and in a more robust way than traditional MF.
arXiv comment26 pages, 12 figures, submitted to The Astrophysical Journal Supplement
References in corpus (27)
- Observation of Gravitational Waves from a Binary Black Hole Merger
- LSTM: A Search Space Odyssey
- Submillimeter Galaxies
- Dusty Star-Forming Galaxies at High Redshift
- FINDCHIRP: an algorithm for detection of gravitational waves from inspiraling compact binaries
- SCUBA-2: The 10000 pixel bolometer camera on the James Clerk Maxwell Telescope
- Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
- AzTEC Millimetre Survey of the COSMOS Field: I. Data Reduction and Source Catalogue
- The AzTEC mm-Wavelength Camera
- A dusty star-forming galaxy at z=6 revealed by strong gravitational lensing
- Atmospheric Scintillation in Astronomical Photometry
- The JCMT Gould Belt Survey: A Quantitative Comparison Between SCUBA-2 Data Reduction Methods
- CRUSH: fast and scalable data reduction for imaging arrays
- On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
- Scintillation correction for astronomical photometry on large and extremely large telescopes with tomographic atmospheric reconstruction
- Modeling atmospheric emission for CMB ground-based observations
- Millimeter-Wave Polarimeters Using Kinetic Inductance Detectors for TolTEC and Beyond
- Spitzer Planck Herschel Infrared Cluster (SPHerIC) survey: Candidate galaxy clusters at 1.3 < z < 3 selected by high star-formation rate
- Studies of Millimeter-Wave Atmospheric Noise Above Mauna Kea
- Turbulence velocity profiling for high sensitivity and vertical-resolution atmospheric characterization with Stereo-SCIDAR
- Calculating the transfer function of noise removal by principal component analysis and application to AzTEC observations
- Optical Design of the TolTEC Millimeter-wave Camera
- MUSCAT: The Mexico-UK Sub-Millimetre Camera for AsTronomy
- Deep learning merger masses estimation from gravitational waves signals in the frequency domain
- Simultaneous Generalized and Low-Layer SCIDAR turbulence profiles at San Pedro Mártir Observatory
- Mexico-UK Sub-millimeter Camera for AsTronomy
- Multiple component decomposition from millimeter single-channel data