Statistical Performance of Radio Interferometric Calibration

Abstract

Calibration is an essential step in radio interferometric data processing that corrects the data for systematic errors and in addition, subtracts bright foreground interference to reveal weak signals hidden in the residual. These weak and unknown signals are much sought after to reach many science goals but the effect of calibration on such signals is an ever present concern. The main reason for this is the incompleteness of the model used in calibration. Distributed calibration based on consensus optimization has been shown to mitigate the effect due to model incompleteness by calibrating data covering a wide bandwidth in a computationally efficient manner. In this paper, we study the statistical performance of direction dependent distributed calibration, i.e., the distortion caused by calibration on the residual statistics. In order to study this, we consider the mapping between the input uncalibrated data and the output residual data. We derive an analytical relationship for the influence of the input on the residual and use this to find the relationship between the input and output probability density functions. Using simulations we show that the smallest eigenvalue of the Jacobian of this mapping is a reliable indicator of the statistical performance of calibration. The analysis developed in this paper can also be applied to other data processing steps in radio interferometry such as imaging and foreground subtraction as well as to many other machine learning problems.

arXiv commentMNRAS Accepted 2019 April 30. Received 2019 April 9; in original form 2018 December 6

References in corpus (28)

• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• Robust Large Margin Deep Neural Networks
• Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
• Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• Radio Interferometric Calibration Using The SAGE Algorithm
• CHIPS: The Cosmological HI Power Spectrum Estimator
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• The Epoch of Reionization
• On Differentiating Parameterized Argmin and Argmax Problems with Application to Bi-level Optimization
• The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
• Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• Multisource Self-calibration for Sensor Arrays
• The Fundamental Multi-Baseline Mode-Mixing Foreground in 21 cm EoR Observations
• Scalable splitting algorithms for big-data interferometric imaging in the SKA era
• Distributed Radio Interferometric Calibration
• The Epoch of Reionization
• Calibration artefacts in radio interferometry. I. Ghost sources in WSRT data
• Robust Radio Interferometric Calibration Using the t-Distribution
• The Bias and Uncertainty of Redundant and Sky-Based Calibration under Realistic Sky and Telescope Conditions
• Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
• An accelerated splitting algorithm for radio-interferometric imaging: when natural and uniform weighting meet
• Robust Calibration of Radio Interferometers in Non-Gaussian Environment
• On the detection of global 21-cm signal from Reionization using interferometers
• On the variance of radio interferometric calibration solutions: Quality-based Weighting Schemes
• Data Multiplexing in Radio Interferometric Calibration
• Clustered Radio Interferometric Calibration

Cited by in corpus (5)

• A numerical study of 21-cm signal suppression and noise increase in direction-dependent calibration of LOFAR data
• Assessing the impact of two independent direction-dependent calibration algorithms on the LOFAR 21-cm signal power spectrum
• Deep reinforcement learning for smart calibration of radio telescopes
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Spatially constrained direction dependent calibration