CubiCal - Fast radio interferometric calibration suite exploiting complex optimisation

Abstract

It has recently been shown that radio interferometric gain calibration can be expressed succinctly in the language of complex optimisation. In addition to providing an elegant framework for further development, it exposes properties of the calibration problem which can be exploited to accelerate traditional non-linear least squares solvers such as Gauss-Newton and Levenberg-Marquardt. We extend existing derivations to chains of Jones terms: products of several gains which model different aberrant effects. In doing so, we find that the useful properties found in the single term case still hold. We also develop several specialised solvers which deal with complex gains parameterised by real values. The newly developed solvers have been implemented in a Python package called CubiCal, which uses a combination of Cython, multiprocessing and shared memory to leverage the power of modern hardware. We apply CubiCal to both simulated and real data, and perform both direction-independent and direction-dependent self-calibration. Finally, we present the results of some rudimentary profiling to show that CubiCal is competitive with respect to existing calibration tools such as MeqTrees.

arXiv comment19 pages, 5 figures, accepted by MNRAS

References in corpus (12)

• The Complex Gradient Operator and the CR-Calculus
• Revisiting the radio interferometer measurement equation. I. A full-sky Jones formalism
• Radio interferometric gain calibration as a complex optimization problem
• Non-linear Kalman filters for calibration in radio interferometry
• Revisiting the radio interferometer measurement equation. II. Calibration and direction-dependent effects
• The MeqTrees software system and its use for third-generation calibration of radio interferometers
• Fast gain calibration in radio astronomy using alternating direction implicit methods: Analysis and applications
• Calibration artefacts in radio interferometry. I. Ghost sources in WSRT data
• Imaging Jupiter's radiation belts down to 127 MHz with LOFAR
• Revisiting the radio interferometer measurement equation. III. Addressing direction-dependent effects in 21 cm WSRT observations of 3C 147
• Applying Wirtinger derivatives to the radio interferometry calibration problem
• Montblanc: GPU accelerated Radio Interferometer Measurement Equations in support of Bayesian Inference for Radio Observations

Cited by in corpus (78)

• Nine-hour X-ray quasi-periodic eruptions from a low-mass black hole galactic nucleus
• Discovery of a radio emitting neutron star with an ultra-long spin period of 76 seconds
• Inflation of 430-parsec bipolar radio bubbles in the Galactic Centre by an energetic event
• Evidence for X-ray Emission in Excess to the Jet Afterglow Decay 3.5 yrs After the Binary Neutron Star Merger GW 170817: A New Emission Component
• Radio and X-ray observations of the luminous Fast Blue Optical Transient AT2020xnd
• Collimated synchrotron threads linking the radio lobes of ESO137-006
• Radio footprints of a minor merger in the Shapley Supercluster: From supercluster down to galactic scales
• MeerKAT uncovers the physics of an Odd Radio Circle
• Unified Radio Interferometric Calibration and Imaging with Joint Uncertainty Quantification
• A MeerKAT view of pre-processing in the Fornax A group
• Jets from MRC 0600-399 bent by magnetic fields in the cluster Abell 3376
• First AI for deep super-resolution wide-field imaging in radio astronomy: unveiling structure in ESO 137--006
• A unique, ring-like radio source with quadrilateral structure detected with machine learning
• MERGHERS Pilot: MeerKAT discovery of diffuse emission in nine massive Sunyaev-Zel'dovich-selected galaxy clusters from ACT
• Discovery of PSR J0523-7125 as a Circularly Polarized Variable Radio Source in the Large Magellanic Cloud
• Detection of X-ray Emission from a Bright Long-Period Radio Transient
• On the nature of the unusual transient AT 2018cow from HI observations of its host galaxy
• The detection of radio emission from known X-ray flaring star EXO 040830-7134.7
• MIGHTEE-HI: deep spectral line observations of the COSMOS field
• Tackling the Unique Challenges of Low-frequency Solar Polarimetry with the Square Kilometre Array Low Precursor: The Algorithm
• Exploring diffuse radio emission in galaxy clusters and groups with the uGMRT and the SKA
• Towards the first detection of strongly lensed HI emission
• The MeerKAT Fornax Survey IV. A close look at the cluster physics through the densest rotation measure grid
• MeerKAT discovery of radio emission from the Vela X-1 bow shock
• A new look at old friends. I. Imaging classical radio galaxies with uGMRT and MeerKAT
• Search and identification of transient and variable radio sources using MeerKAT observations: a case study on the MAXI J1820+070 field
• Simultaneous X-ray and radio observations of the transitional millisecond pulsar candidate CXOU J110926.4-650224. The discovery of a variable radio counterpart
• MeerKAT-16 HI observation of the dIrr galaxy WLM
• MeerKAT discovers a jet-driven bow shock near GRS 1915+105. How an invisible large-scale jet sculpts a microquasar's environment
• The Panchromatic Afterglow of GW170817: The full uniform dataset, modeling, comparison with previous results and implications
• Unusual Galactic HII Regions at the Intersection of the Central Molecular Zone and the Far Dust Lane
• HI Galaxy Signatures in the SARAO MeerKAT Galactic Plane Survey -- II. The Local Void and its substructure
• A MeerKAT, e-MERLIN, H.E.S.S. and Swift search for persistent and transient emission associated with three localised FRBs
• MeerKAT follow-up of enigmatic GLEAM 4-Jy (G4Jy) sources
• Bursts from Space: MeerKAT - The first citizen science project dedicated to commensal radio transients
• Non-thermal filaments and AGN recurrent activity in the galaxy group Nest200047: a LOFAR, uGMRT, MeerKAT, VLA radio spectral analysis
• Anomalous gas in ESO 149-G003: A MeerKAT-16 View
• The detection of a massive chain of dark HI clouds in the GAMA G23 Field
• Mining Mini-Halos with MeerKAT I. Calibration and Imaging
• Cosmic dance in the Shapley Concentration Core II. The uGMRT-MeerKAT view of filaments in the brightest cluster galaxies and tailed radio galaxies in the A3528 cluster complex
• Tackling the Unique Challenges of Low-frequency Solar Polarimetry with the Square Kilometre Array Low Precursor: Pipeline Implementation
• Quantifying jet-interstellar medium interactions in Cyg X-1: Insights from dual-frequency bow shock detection with MeerKAT
• Connecting MeerKAT radio continuum properties to GAMA optical emission-line and WISE mid-infrared activity
• MeerKAT-64 discovers wide-spread tidal debris in the nearby NGC 7232 galaxy group
• MeerKAT's discovery of a radio relic in the bimodal merging cluster A2384
• A new pulsar candidate in 47 Tucanae discovered with MeerKAT imaging
• The extended HI halo of NGC 4945 as seen by MeerKAT
• The MeerKAT Massive Distant Clusters Survey: A Radio Halo in a Massive Galaxy Cluster at z = 1.23
• The MeerKAT Massive Distant Clusters Survey: detection of diffuse radio emission in galaxy clusters at $z>1$
• The interstellar medium in the environment of the supernova-less long-duration GRB 111005A
• fast-resolve: Fast Bayesian Radio Interferometric Imaging
• Preparing for Solar and Heliospheric Science with the SKAO: An Indian Perspective
• High-$z$ radio Quasars in RACS I: Selection, identification, and multi-wavelength properties
• The Black Hole Candidate Swift J1728.9$-$3613 and the Supernova Remnant G351.9$-$0.9
• Evidence of mutually exclusive outflow forms from a black hole X-ray binary
• A MeerKAT view on galaxy clusters: a radio-optical study of Abell 1300 and MACS J1931.8--2634
• MeerKAT caught a Mini Mouse: serendipitous detection of a young radio pulsar escaping its birth sit
• A Spectropolarimetric Study of Pictor A Radio Galaxy with MeerKAT
• Large-scale radio bubbles around the black hole transient V4641 Sgr
• 21 cm Intensity Mapping with the DSA-2000
• The Accretion-Ejection Connection in the Black Hole X-ray Binary MAXI J1820$+$070
• HI in and behind the Hubble Frontier Field Clusters: A Deep MeerKAT Pilot Search out to $z\sim 0.5$
• A 15 Mpc rotating galaxy filament at redshift z = 0.032
• Spectral features and variable circular polarisation in the radio emission from the pre-cataclysmic variable QS Vir
• MeerKAT view of Hickson Compact Groups:I. Data description and release
• A MeerKAT survey of nearby dwarf novae: I. New detections
• The radio afterglow of the ultra-long GRB 220627A
• MeerKAT 21-cm HI imaging of Abell 2626 and beyond
• A persistent bow shock in a diskless magnetised accreting white dwarf
• MOSS I: Double radio relics in the Saraswati supercluster
• uGMRT and MeerKAT observation of RXCJ0232-4420: a quiet cluster with a giant radio halo
• The MeerKAT Fornax Survey -- I. Survey description and first evidence of ram pressure in the Fornax galaxy cluster
• HI gas in the rejuvenated radio galaxy PKS 2014-55
• Third-Generation Calibrations for MeerKAT observation
• A novel algorithm for high fidelity spectro-polarimetric snapshot imaging of the low-frequency radio Sun using SKA-low precursor
• The MeerKAT Massive Distant Clusters Survey: a search for diffuse radio emission in 30 massive SZ-selected clusters at $z>1$
• MIGHTEE: total intensity radio continuum imaging and the COSMOS / XMM-LSS Early Science fields
• MeerKAT observations of Procyon at 815.5 MHz