HIDE & SEEK: End-to-End Packages to Simulate and Process Radio Survey Data
arXiv:1607.07443 · doi:10.1016/j.ascom.2016.11.001
Abstract
As several large single-dish radio surveys begin operation within the coming decade, a wealth of radio data will become available and provide a new window to the Universe. In order to fully exploit the potential of these data sets, it is important to understand the systematic effects associated with the instrument and the analysis pipeline. A common approach to tackle this is to forward-model the entire system - from the hardware to the analysis of the data products. For this purpose, we introduce two newly developed, open-source Python packages: the HI Data Emulator (HIDE) and the Signal Extraction and Emission Kartographer (SEEK) for simulating and processing single-dish radio survey data. HIDE forward-models the process of collecting astronomical radio signals in a single-dish radio telescope instrument and outputs pixel-level time-ordered-data. SEEK processes the time-ordered-data, removes artifacts from Radio Frequency Interference (RFI), automatically applies flux calibration, and aims to recover the astronomical radio signal. The two packages can be used separately or together depending on the application. Their modular and flexible nature allows easy adaptation to other instruments and data sets. We describe the basic architecture of the two packages and examine in detail the noise and RFI modeling in HIDE, as well as the implementation of gain calibration and RFI mitigation in SEEK. We then apply HIDE & SEEK to forward-model a Galactic survey in the frequency range 990 - 1260 MHz based on data taken at the Bleien Observatory. For this survey, we expect to cover 70% of the full sky and achieve a median signal-to-noise ratio of approximately 5 - 6 in the cleanest channels including systematic uncertainties. However, we also point out the potential challenges of high RFI contamination and baseline removal when examining the early data from the Bleien Observatory.
arXiv comment15 pages, 7 figures Published in Astronomy and Computing. The code is available at http://hideseek.phys.ethz.ch
References in corpus (16)
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- Dark Matter Annihilation in The Galactic Center As Seen by the Fermi Gamma Ray Space Telescope
- A model of diffuse Galactic Radio Emission from 10 MHz to 100 GHz
- What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
- Post-correlation radio frequency interference classification methods
- HI intensity mapping : a single dish approach
- Handbook for the GREAT08 Challenge: An image analysis competition for cosmological lensing
- Simulation of Astronomical Images from Optical Survey Telescopes using a Comprehensive Photon Monte Carlo Approach
- A simulation pipeline for the Planck mission
- SERPent: Automated reduction and RFI-mitigation software for e-MERLIN
- BINGO: a single dish approach to 21cm intensity mapping
- A LOFAR RFI detection pipeline and its first results
- HI intensity mapping with FAST
- An Integrated System at the Bleien Observatory for Mapping the Galaxy
- HI tomographic imaging of the Cosmic Dawn and Epoch of Reionization with SKA
- The LOFAR Transients Pipeline
Cited by in corpus (11)
- HI intensity mapping with MeerKAT: power spectrum detection in cross-correlation with WiggleZ galaxies
- HI intensity mapping with MeerKAT: Calibration pipeline for multi-dish autocorrelation observations
- Deep residual detection of radio frequency interference for FAST
- Deep Learning improves identification of Radio Frequency Interference
- Radio Frequency Interference Mitigation based on the ArPLS and SumThreshold Method
- Implementing RFI mitigation in Radio Science
- Learning to detect RFI in radio astronomy without seeing it
- Deep Learning Assisted Data Inspection for Radio Astronomy
- Radio Frequency Interference Detection Using Efficient Multi-Scale Convolutional Attention UNet
- Unveiling the Universe with Emerging Cosmological Probes
- Performance of the Segment Anything Model in Various RFI/Events Detection in Radio Astronomy