DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra

Abstract

We introduce DAYENU, a linear, spectral filter for HI intensity mapping that achieves the desirable foreground mitigation and error minimization properties of inverse co-variance weighting with minimal modeling of the underlying data. Beyond 21 cm power-spectrum estimation, our filter is suitable for any analysis where high dynamic-range removal of spectrally smooth foregrounds in irregularly (or regularly) sampled data is required, something required by many other intensity mapping techniques. Our filtering matrix is diagonalized by Discrete Prolate Spheroidal Sequences which are an optimal basis to model band-limited foregrounds in 21 cm intensity mapping experiments in the sense that they maximally concentrate power within a finite region of Fourier space. We show that DAYENU enables the access of large-scale line-of-sight modes that are inaccessible to tapered DFT estimators. Since these modes have the largest SNRs, DAYENU significantly increases the sensitivity of 21 cm analyses over tapered Fourier transforms. Slight modifications allow us to use DAYENU as a linear replacement for iterative delay CLEANing (DAYENUREST). We refer readers to the Code section at the end of this paper for links to examples and code.

arXiv commentAccepted to MNRAS, 19 pages, 17 figures. Replacement matches accepted version

References in corpus (62)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• LOFAR: The LOw-Frequency ARray
• The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
• Hydrogen Epoch of Reionization Array (HERA)
• A model of diffuse Galactic Radio Emission from 10 MHz to 100 GHz
• How to measure CMB power spectra without losing information
• Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
• What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
• Measurement of 21 cm brightness fluctuations at z ~ 0.8 in cross-correlation
• A Per-Baseline, Delay-Spectrum Technique for Accessing the 21cm Cosmic Reionization Signature
• Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• The Epoch of Reionization Window: I. Mathematical Formalism
• New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7
• PAPER-64 Constraints on Reionization: The 21cm Power Spectrum at z=8.4
• Determination of z~0.8 neutral hydrogen fluctuations using the 21 cm intensity mapping auto-correlation
• Toward Epoch of Reionization Measurements with Wide-Field Radio Observations
• Data Analysis for Precision 21 cm Cosmology
• Imaging the Epoch of Reionization: limitations from foreground confusion and imaging algorithms
• Canadian Hydrogen Intensity Mapping Experiment (CHIME) Pathfinder
• The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction
• A Sensitivity and Array-Configuration Study for Measuring the Power Spectrum of 21cm Emission from Reionization
• An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz
• All-Sky Interferometry with Spherical Harmonic Transit Telescopes
• A Method for 21cm Power Spectrum Estimation in the Presence of Foregrounds
• Opening the 21cm EoR Window: Measurements of Foreground Isolation with PAPER
• Foreground Removal using FastICA: A Showcase of LOFAR-EoR
• Lack of clustering in low-redshift 21-cm intensity maps cross-correlated with 2dF galaxy densities
• HIRAX: A Probe of Dark Energy and Radio Transients
• First Season MWA EoR Power Spectrum Results at Redshift 7
• A simplified, lossless re-analysis of PAPER-64
• CHIPS: The Cosmological HI Power Spectrum Estimator
• Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data
• The 21 centimeter emission from the reionization epoch: extended and point source foregrounds
• Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
• First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
• The Radio Sky at Meter Wavelengths: m-Mode Analysis Imaging with the Owens Valley Long Wavelength Array
• Interpreting the unresolved intensity of cosmologically redshifted line radiation
• Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations
• Effects of Antenna Beam Chromaticity on Redshifted 21~cm Power Spectrum and Implications for Hydrogen Epoch of Reionization Array
• Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array
• Quantifying angular clustering in wide-area radio surveys
• A Fast Method for Power Spectrum and Foreground Analysis for 21 cm Cosmology
• The Murchison Widefield Array 21 cm Power Spectrum Analysis Methodology
• Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
• The Hydrogen Epoch of Reionization Array Dish I: Beam Pattern Measurements and Science Implications
• Constraining High Redshift X-ray Sources with Next Generation 21 cm Power Spectrum Measurements
• Optimizing Sparse RFI Prediction using Deep Learning
• Measuring Phased-Array Antenna Beampatterns with High Dynamic Range for the Murchison Widefield Array using 137 MHz ORBCOMM Satellites
• The FHD/$\mathbf{\epsilon }$ppsilon Epoch of Reionization Power Spectrum Pipeline
• Understanding the HERA Phase I receiver system with simulations and its impact on the detectability of the EoR delay power spectrum
• The Hydrogen Epoch of Reionization Array Dish II: Characterization of Spectral Structure with Electromagnetic Simulations and its science Implications
• A Technique for Primary Beam Calibration of Drift-Scanning, Wide-Field Antenna Elements
• New 145-MHz Source Measurements by PAPER in the Southern Sky
• PUMA: The Positional Update and Matching Algorithm
• A High Reliability Survey of Discrete Epoch of Reionization Foreground Sources in the MWA EoR0 Field
• The Ooty Wide Field Array
• Fundamental uncertainty levels of 21cm power spectra from a delay analysis
• The Hydrogen Epoch of Reionization Array Dish III: Measuring Chromaticity of Prototype Element with Reflectometry
• Quantifying EoR delay spectrum contamination from diffuse radio emission
• Unlocking Sensitivity for Visibility-based Estimators of the 21 cm Reionization Power Spectrum

Cited by in corpus (28)

• First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
• Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations
• Detection of Cosmological 21 cm Emission with the Canadian Hydrogen Intensity Mapping Experiment
• Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
• Foreground modelling via Gaussian process regression: an application to HERA data
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array
• Statistical recovery of the BAO scale from multipoles of the beam-convolved 21cm correlation function
• On the use of temporal filtering for mitigating galactic synchrotron calibration bias in 21 cm reionization observations
• Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator III: Foreground removal
• The Tracking Tapered Gridded Estimator for the 21-cm power spectrum from MWA drift scan observations I: Validation and preliminary results
• Multi-frequency angular power spectrum of the 21~cm signal from the Epoch of Reionisation using the Murchison Widefield Array
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator -- IV. Wideband analysis
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator II: Cross-polarization power spectrum
• Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements
• A Comparative Analysis To Deal With Missing Spectral Information Caused By RFI In Cosmological HI 21CM Observations
• A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
• A novel radio imaging method for physical spectral index modelling
• Holographic Beam Measurements of the Canadian Hydrogen Intensity Mapping Experiment (CHIME)
• Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
• Beam Maps of the Canadian Hydrogen Intensity Mapping Experiment (CHIME) Measured with a Drone
• Exploring One-point Statistics in HERA Phase I Data: Effects of Foregrounds and Systematics on Measuring One-Point Statistics
• Drone Beam Mapping of the TONE Radio Dish Array
• A Digital Calibration Source for 21cm Cosmology Telescopes
• Foreground removal and angular power spectrum estimation of 21 cm signal using harmonic space ILC method
• Removing systematics-induced 21-cm foreground residuals by cross-correlating filtered data
• Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum