Distributed and parallel sparse convex optimization for radio interferometry with PURIFY
arXiv:1903.04502
Abstract
Next generation radio interferometric telescopes are entering an era of big data with extremely large data sets. While these telescopes can observe the sky in higher sensitivity and resolution than before, computational challenges in image reconstruction need to be overcome to realize the potential of forthcoming telescopes. New methods in sparse image reconstruction and convex optimization techniques (cf. compressive sensing) have shown to produce higher fidelity reconstructions of simulations and real observations than traditional methods. This article presents distributed and parallel algorithms and implementations to perform sparse image reconstruction, with significant practical considerations that are important for implementing these algorithms for Big Data. We benchmark the algorithms presented, showing that they are considerably faster than their serial equivalents. We then pre-sample gridding kernels to scale the distributed algorithms to larger data sizes, showing application times for 1 Gb to 2.4 Tb data sets over 25 to 100 nodes for up to 50 billion visibilities, and find that the run-times for the distributed algorithms range from 100 milliseconds to 3 minutes per iteration. This work presents an important step in working towards computationally scalable and efficient algorithms and implementations that are needed to image observations of both extended and compact sources from next generation radio interferometers such as the SKA. The algorithms are implemented in the latest versions of the SOPT (https://github.com/astro-informatics/sopt) and PURIFY (https://github.com/astro-informatics/purify) software packages {(Versions 3.1.0)}, which have been released alongside of this article.
arXiv comment25 pages, 5 figures
References in corpus (17)
- The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
- PURIFY: a new approach to radio-interferometric imaging
- LOFAR Sparse Image Reconstruction
- Super-resolution Full Polarimetric Imaging for Radio Interferometry with Sparse Modeling
- Scalable splitting algorithms for big-data interferometric imaging in the SKA era
- Uncertainty quantification for radio interferometric imaging: I. proximal MCMC methods
- Compressed sensing for wide-field radio interferometric imaging
- Robust sparse image reconstruction of radio interferometric observations with purify
- A generalised Measurement Equation and van Cittert-Zernike theorem for wide-field radio astronomical interferometry
- Uncertainty quantification for radio interferometric imaging: II. MAP estimation
- Simulating full-sky interferometric observations
- Cygnus A super-resolved via convex optimisation from VLA data
- Sparse representations and convex optimization as tools for LOFAR radio interferometric imaging
- An improved method for polarimetric image restoration in interferometry
- Sparse interferometric Stokes imaging under polarization constraint (Polarized SARA)
- Using SKA Rotation Measures to Reveal the Mysteries of the Magnetised Universe
- Generalized Formalisms of the Radio Interferometer Measurement Equation