The MeqTrees software system and its use for third-generation calibration of radio interferometers

Abstract

The formulation of the radio interferometer measurement equation (RIME) by Hamaker et al. has provided us with an elegant mathematical apparatus for better understanding, simulation and calibration of existing and future instruments. The calibration of the new radio telescopes (LOFAR, SKA) would be unthinkable without the RIME formalism, and new software to exploit it. MeqTrees is designed to implement numerical models such as the RIME, and to solve for arbitrary subsets of their parameters. The technical goal of MeqTrees is to provide a tool for rapid implementation of such models, while offering performance comparable to hand-written code. We are also pursuing the wider goal of increasing the rate of evolution of radio astronomical software, by offering a tool for rapid experimentation and exchange of ideas. MeqTrees is implemented as a Python-based front-end called the meqbrowser, and an efficient (C++-based) computational back-end called the meqserver. Numerical models are defined on the front-end via a Python-based Tree Definition Language (TDL), then rapidly executed on the back-end. The use of TDL facilitates an extremely short turn-around time for experimentation with new ideas. This is also helped by unprecedented visualization capabilities for all final and intermediate results. A flexible data model and a number of important optimizations in the back-end ensures that the numerical performance is comparable to that of hand-written code. MeqTrees is already widely used as the simulation tool for new instruments (LOFAR, SKA) and technologies (focal plane arrays). It has demonstrated that it can achieve a noise-limited dynamic range in excess of a million, on WSRT data. It is the only package that is specifically designed to handle what we propose to call third-generation calibration (3GC), which is needed for the new generation of giant radio telescopes.

15 pages; 14 figures

References in corpus (1)

• Correcting direction-dependent gains in the deconvolution of radio interferometric images

Cited by in corpus (63)

• First M87 Event Horizon Telescope Results. IV. Imaging the Central Supermassive Black Hole
• The LOFAR Two-metre Sky Survey - II. First data release
• LOFAR facet calibration
• Revisiting the radio interferometer measurement equation. I. A full-sky Jones formalism
• Faceting for direction-dependent spectral deconvolution
• Radio interferometric gain calibration as a complex optimization problem
• BlackHoleCam: fundamental physics of the Galactic center
• A close-pair binary in a distant triple supermassive black-hole system
• Non-linear Kalman filters for calibration in radio interferometry
• CubiCal - Fast radio interferometric calibration suite exploiting complex optimisation
• Revisiting the radio interferometer measurement equation. II. Calibration and direction-dependent effects
• The Australian Square Kilometre Array Pathfinder: Performance of the Boolardy Engineering Test Array
• Fast gain calibration in radio astronomy using alternating direction implicit methods: Analysis and applications
• MORESANE: MOdel REconstruction by Synthesis-ANalysis Estimators. A sparse deconvolution algorithm for radio interferometric imaging
• Radio footprints of a minor merger in the Shapley Supercluster: From supercluster down to galactic scales
• Calibration artefacts in radio interferometry. I. Ghost sources in WSRT data
• DeepSource: Point Source Detection using Deep Learning
• The closest black holes
• Revisiting the radio interferometer measurement equation. III. Addressing direction-dependent effects in 21 cm WSRT observations of 3C 147
• Unified Radio Interferometric Calibration and Imaging with Joint Uncertainty Quantification
• The flickering nuclear activity of Fornax A
• VLA imaging of the XMM-LSS / VIDEO deep field at 1-2 GHz
• Neutral hydrogen gas within and around NGC 1316
• Wide-field broadband radio imaging with phased array feeds: a pilot multi-epoch continuum survey with ASKAP-BETA
• Robust Calibration of Radio Interferometers in Non-Gaussian Environment
• Revisiting the radio interferometer measurement equation. IV. A generalized tensor formalism
• The twisted jets of Circinus X-1
• Bayesian Inference for Radio Observations
• Montblanc: GPU accelerated Radio Interferometer Measurement Equations in support of Bayesian Inference for Radio Observations
• MeqSilhouette : A mm-VLBI observation and signal corruption simulator
• Carbon radio recombination lines from gigahertz to megahertz frequencies towards Orion A
• ASGARD: A Large Survey for Slow Galactic Radio Transients. I. Overview and First Results
• Implementation of a Direct-Imaging and FX Correlator for the BEST-2 Array
• Scalable precision wide-field imaging in radio interferometry: I. uSARA validated on ASKAP data
• Using baseline-dependent window functions for data compression and field-of-interest shaping in radio interferometry
• MeqSilhouette v2: Spectrally-resolved polarimetric synthetic data generation for the Event Horizon Telescope
• Resolving the blazar CGRaBS J0809+5341 in the presence of telescope systematics
• Towards the first detection of strongly lensed HI emission
• A new look at old friends. I. Imaging classical radio galaxies with uGMRT and MeerKAT
• The w-effect in interferometric imaging: from a fast sparse measurement operator to super-resolution
• The Panchromatic Afterglow of GW170817: The full uniform dataset, modeling, comparison with previous results and implications
• Redundant interferometric calibration as a complex optimization problem
• A parallel & automatically tuned algorithm for multispectral image deconvolution
• Baseline-dependent sampling and windowing for radio interferometry: data compression, field-of-interest shaping and outer field suppression
• Sub-millimetre source identifications and the micro-Jansky source population at 8.4 GHz in the William Herschel Deep Field
• Parallel faceted imaging in radio interferometry via proximal splitting (Faceted HyperSARA): II. Code and real data proof of concept
• Mining Mini-Halos with MeerKAT I. Calibration and Imaging
• Radio Galaxy Shape Measurement with Hamiltonian Monte Carlo in the Visibility Domain
• OmniUV: A Multi-Purpose Simulation Toolkit for VLBI Observation
• The application of MultiView Methods for High Precision Astrometric Space VLBI at Low Frequencies
• Weak Lensing Measurements in Simulations of Radio Images
• Field sources near the southern-sky calibrator PKS B1934-638: effect on spectral line observations with SKA-MID and its precursors
• Validation Solutions to the Full-Sky Radio Interferometry Measurement Equation for Diffuse Emission
• The extended HI halo of NGC 4945 as seen by MeerKAT
• The MeerKAT Massive Distant Clusters Survey: detection of diffuse radio emission in galaxy clusters at $z>1$
• Rapid Development of Interferometric Software Using MIRIAD and Python
• Improving self-calibration
• HI in and behind the Hubble Frontier Field Clusters: A Deep MeerKAT Pilot Search out to $z\sim 0.5$
• Axion-like particle searches with MeerKAT and SKA
• Toward a Robust R2D2 Paradigm for Radio-interferometric Imaging: Revisiting Deep Neural Network Training and Architecture
• MOSS I: Double radio relics in the Saraswati supercluster
• The MeerKAT Massive Distant Clusters Survey: a search for diffuse radio emission in 30 massive SZ-selected clusters at $z>1$
• MIGHTEE: total intensity radio continuum imaging and the COSMOS / XMM-LSS Early Science fields