Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
arXiv:2104.09547 · doi:10.3847/1538-4357/ac32cd
Abstract
We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2 sigma level) for k > 0.2 h/Mpc for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong `detection' at k ~0.2 h/Mpc -- at the level of ~25 sigma -- with foregrounds dominating on larger scales, and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of > 10^7. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well-characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis.
arXiv comment32 pages, 20 figures. Submitted to the Astrophysical Journal
References in corpus (66)
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- LOFAR: The LOw-Frequency ARray
- The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
- Hydrogen Epoch of Reionization Array (HERA)
- GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey I: A low-frequency extragalactic catalogue
- A model of diffuse Galactic Radio Emission from 10 MHz to 100 GHz
- What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
- A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
- A Per-Baseline, Delay-Spectrum Technique for Accessing the 21cm Cosmic Reionization Signature
- Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at from LOFAR
- Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
- PAPER-64 Constraints on Reionization: The 21cm Power Spectrum at z=8.4
- Data Analysis for Precision 21 cm Cosmology
- Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations
- A Sensitivity and Array-Configuration Study for Measuring the Power Spectrum of 21cm Emission from Reionization
- An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz
- Overcoming real-world obstacles in 21 cm power spectrum estimation: A method demonstration and results from early Murchison Widefield Array data
- All-Sky Interferometry with Spherical Harmonic Transit Telescopes
- Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
- The GMRT-EoR Experiment: A new upper limit on the neutral hydrogen power spectrum at z~8.6
- A novel sampling theorem on the sphere
- First Season MWA EoR Power Spectrum Results at Redshift 7
- Foregrounds in Wide-Field Redshifted 21 cm Power Spectra
- A simplified, lossless re-analysis of PAPER-64
- Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
- The Scale of the Problem : Recovering Images of Reionization with GMCA
- CHIPS: The Cosmological HI Power Spectrum Estimator
- Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
- The 21 cm Power Spectrum from the Cosmic Dawn: First Results from the OVRO-LWA
- The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
- First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
- First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
- Fundamental Limitations on the Calibration of Redundant 21 cm Cosmology Instruments and Implications for HERA and the SKA
- Calibration of Low-Frequency, Wide-Field Radio Interferometers Using Delay/Delay-Rate Filtering
- Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array
- Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations
- Redundant Array Configurations for 21 cm Cosmology
- The Murchison Widefield Array 21 cm Power Spectrum Analysis Methodology
- Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
- Mitigating the Effects of Antenna-to-Antenna Variation on Redundant-Baseline Calibration for 21 cm Cosmology
- Understanding the Diversity of 21 cm Cosmology Analyses
- The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
- Redundant-Baseline Calibration of the Hydrogen Epoch of Reionization Array
- Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
- Modelling of the Spectral Energy Distribution of Fornax A: Leptonic and Hadronic Production of High Energy Emission from the Radio Lobes
- Spherical Harmonic Analyses of Intensity Mapping Power Spectra
- The FHD/ppsilon Epoch of Reionization Power Spectrum Pipeline
- Understanding the HERA Phase I receiver system with simulations and its impact on the detectability of the EoR delay power spectrum
- Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum
- Optimized Beam Sculpting with Generalized Fringe-Rate Filters
- Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
- Polarization leakage in epoch of reionization windows: II. Primary beam model and direction dependent calibration
- Polarization leakage in epoch of reionization windows: III. Wide-field effects of narrow-field arrays
- Patterns of primary beam non-redundancy in close-packed 21 cm array observations
- Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
- Detection of Signals from Cosmic Reionization using Radio Interferometric Signal Processing
- Precision requirements for interferometric gridding in 21-cm power spectrum analysis
- A numerical study of 21-cm signal suppression and noise increase in direction-dependent calibration of LOFAR data
- Constraining Polarized Foregrounds for EOR Experiments II: Polarization Leakage Simulations in the Avoidance Scheme
- Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements
- Design of the New Wideband Vivaldi Feed for the HERA Radio-Telescope Phase II
- Fundamental uncertainty levels of 21cm power spectra from a delay analysis
- Methods of Error Estimation for Delay Power Spectra in Cosmology
- Antenna design for the SKA1-LOW and HERA super radio telescopes
- Quantifying EoR delay spectrum contamination from diffuse radio emission
- Ionospheric Attenuation of Polarized Foregrounds in 21 cm Epoch of Reionization Measurements: A Demonstration for the HERA Experiment
Cited by in corpus (17)
- First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
- Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations
- HERA Phase I Limits on the Cosmic 21-cm Signal: Constraints on Astrophysics and Cosmology During the Epoch of Reionization
- New EoR Power Spectrum Limits From MWA Phase II Using the Delay Spectrum Method and Novel Systematic Rejection
- Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
- SKA-Low Intensity Mapping Pathfinder Updates: Deeper 21 cm Power Spectrum Limits from Improved Analysis Frameworks
- All Sky Modelling Requirements for Bayesian 21 cm Power Spectrum Estimation with BayesEoR
- Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
- Direct Optimal Mapping for 21cm Cosmology: A Demonstration with the Hydrogen Epoch of Reionization Array
- Validation Solutions to the Full-Sky Radio Interferometry Measurement Equation for Diffuse Emission
- A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
- Search for the Epoch of Reionisation with HERA: Upper Limits on the Closure Phase Delay Power Spectrum
- Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors
- Low-Frequency Radio Recombination Lines Away From the Inner Galactic Plane
- Bayesian jackknife tests with a small number of subsets: Application to HERA 21cm power spectrum upper limits
- Establishing a relationship between the cosmological 21 cm power spectrum and interferometric closure phases
- A Real Time Processing System for Big Data in Astronomy: Applications to HERA