Stochastic Calibration of Radio Interferometers
arXiv:2003.00986 · doi:10.1093/mnras/staa648
Abstract
With ever increasing data rates produced by modern radio telescopes like LOFAR and future telescopes like the SKA, many data processing steps are overwhelmed by the amount of data that needs to be handled using limited compute resources. Calibration is one such operation that dominates the overall data processing computational cost, nonetheless, it is an essential operation to reach many science goals. Calibration algorithms do exist that scale well with the number of stations of an array and the number of directions being calibrated. However, the remaining bottleneck is the raw data volume, which scales with the number of baselines, and which is proportional to the square of the number of stations. We propose a 'stochastic' calibration strategy where we only read in a mini-batch of data for obtaining calibration solutions, as opposed to reading the full batch of data being calibrated. Nonetheless, we obtain solutions that are valid for the full batch of data. Normally, data need to be averaged before calibration is performed to accommodate the data in size-limited compute memory. Stochastic calibration overcomes the need for data averaging before any calibration can be performed, and offers many advantages including: enabling the mitigation of faint radio frequency interference; better removal of strong celestial sources from the data; and better detection and spatial localization of fast radio transients.
arXiv commentMNRAS Accepted 2020 March 2. Received 2020 March 2 ; in original form 2020 January 27
References in corpus (18)
- Adam: A Method for Stochastic Optimization
- LOFAR: The LOw-Frequency ARray
- The direct localization of a fast radio burst and its host
- Faraday Rotation Measure Synthesis
- Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks
- Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
- Distributed Radio Interferometric Calibration
- Absolving the SSINS of Precision Interferometric Radio Data: A New Technique for Mitigating Faint Radio Frequency Interference
- A Progressive Batching L-BFGS Method for Machine Learning
- Robust Radio Interferometric Calibration Using the t-Distribution
- Rotation measure synthesis revisited
- A Multi-Batch L-BFGS Method for Machine Learning
- On the interpolation of calibration solutions obtained in radio interferometry
- Data Multiplexing in Radio Interferometric Calibration
- A probabilistic approach to direction-dependent ionospheric calibration
- Implementation of Stochastic Quasi-Newton's Method in PyTorch
- GPU acceleration of the SAGECal calibration package for the SKA
- Parallel Calibration for Sensor Array Radio Interferometers