Distributed Radio Interferometric Calibration

Abstract

Increasing data volumes delivered by a new generation of radio interferometers require computationally efficient and robust calibration algorithms. In this paper, we propose distributed calibration as a way of improving both computational cost as well as robustness in calibration. We exploit the data parallelism across frequency that is inherent in radio astronomical observations that are recorded as multiple channels at different frequencies. Moreover, we also exploit the smoothness of the variation of calibration parameters across frequency. Data parallelism enables us to distribute the computing load across a network of compute agents. Smoothness in frequency enables us reformulate calibration as a consensus optimization problem. With this formulation, we enable flow of information between compute agents calibrating data at different frequencies, without actually passing the data, and thereby improving robustness. We present simulation results to show the feasibility as well as the advantages of distributed calibration as opposed to conventional calibration.

MNRAS Accepted 2015 March 13. Received 2015 January 28; in original form 2014 November 6, low resolution figures

References in corpus (10)

• On the Linear Convergence of the ADMM in Decentralized Consensus Optimization
• Multi-Agent Distributed Optimization via Inexact Consensus ADMM
• D-ADMM: A Communication-Efficient Distributed Algorithm For Separable Optimization
• Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
• Non-linear Kalman filters for calibration in radio interferometry
• PURIFY: a new approach to radio-interferometric imaging
• Radio Interferometric Calibration Using The SAGE Algorithm
• Robust Radio Interferometric Calibration Using the t-Distribution
• On the interpolation of calibration solutions obtained in radio interferometry
• Reduced Ambiguity Calibration for LOFAR

Cited by in corpus (53)

• The LOFAR Two-metre Sky Survey - I. Survey Description and Preliminary Data Release
• The LOFAR Two-metre Sky Survey - II. First data release
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• LOFAR facet calibration
• The LOFAR Two Meter Sky Survey: Deep Fields, I -- Direction-dependent calibration and imaging
• Data Analysis for Precision 21 cm Cosmology
• First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
• Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• Scalable splitting algorithms for big-data interferometric imaging in the SKA era
• Spectral calibration requirements of radio interferometers for Epoch of Reionisation science with the SKA
• Redundant-Baseline Calibration of the Hydrogen Epoch of Reionization Array
• The AARTFAAC Cosmic Explorer: observations of the 21-cm power spectrum in the EDGES absorption trough
• Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
• An accelerated splitting algorithm for radio-interferometric imaging: when natural and uniform weighting meet
• A Unified Calibration Framework for 21 cm Cosmology
• Science with the Murchison Widefield Array: Phase I Results and Phase II Opportunities
• Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
• Calibration and 21-cm Power Spectrum Estimation in the Presence of Antenna Beam Variations
• A numerical study of 21-cm signal suppression and noise increase in direction-dependent calibration of LOFAR data
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• Assessing the impact of two independent direction-dependent calibration algorithms on the LOFAR 21-cm signal power spectrum
• Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array
• Deep reinforcement learning for smart calibration of radio telescopes
• On the use of temporal filtering for mitigating galactic synchrotron calibration bias in 21 cm reionization observations
• Data Multiplexing in Radio Interferometric Calibration
• Degree-Scale Galactic Radio Emission at 122 MHz around the North Celestial Pole with LOFAR-AARTFAAC
• The Impact of Tandem Redundant/Sky-Based Calibration in MWA Phase II Data Analysis
• Effects of model incompleteness on the drift-scan calibration of radio telescopes
• Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
• Stochastic Calibration of Radio Interferometers
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Statistical Performance of Radio Interferometric Calibration
• Delay-Weighted Calibration: Precision Calibration for 21 cm Cosmology with Resilience to Sky Model Error
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• Spatially constrained direction dependent calibration
• Probing the Epoch of Reionization using synergies of line intensity mapping
• Parallel Calibration for Sensor Array Radio Interferometers
• Diffuse radio sky models using large scale shapelets
• 21 cm Intensity Mapping with the DSA-2000
• Robust direction-dependent gain-calibration of beam-modelling errors far from the target field
• A novel radio imaging method for physical spectral index modelling
• The impact of lossy data compression on the power spectrum of the high redshift 21-cm signal with LOFAR
• Imaging swiFTly: streaming widefield Fourier Transforms for large-scale interferometry
• Multi-frequency calibration for DOA estimation with distributed sensors
• The impact of lunar topography on the 21-cm power spectrum for grid-based arrays : Insights for the Dark-ages EXplorer (DEX)
• A Bayesian approach to high fidelity interferometric calibration I: mathematical formalism
• Scaling performance of the SAGECal calibration package: from LOFAR to SKA
• Robust distributed calibration of radio interferometers with direction dependent distortions
• Bayesian Calibration using Different Prior Distributions: an Iterative Maximum A Posteriori Approach for Radio Interferometers
• Robust Calibration of Radio Interferometers in Multi-Frequency Scenario
• Lossless compression of simulated radio interferometric visibilities