Radio interferometric gain calibration as a complex optimization problem
arXiv:1502.06974 · doi:10.1093/mnras/stv418
Abstract
Recent developments in optimization theory have extended some traditional algorithms for least-squares optimization of real-valued functions (Gauss-Newton, Levenberg-Marquardt, etc.) into the domain of complex functions of a complex variable. This employs a formalism called the Wirtinger derivative, and derives a full-complex Jacobian counterpart to the conventional real Jacobian. We apply these developments to the problem of radio interferometric gain calibration, and show how the general complex Jacobian formalism, when combined with conventional optimization approaches, yields a whole new family of calibration algorithms, including those for the polarized and direction-dependent gain regime. We further extend the Wirtinger calculus to an operator-based matrix calculus for describing the polarized calibration regime. Using approximate matrix inversion results in computationally efficient implementations; we show that some recently proposed calibration algorithms such as StefCal and peeling can be understood as special cases of this, and place them in the context of the general formalism. Finally, we present an implementation and some applied results of CohJones, another specialized direction-dependent calibration algorithm derived from the formalism.
18 pages; 6 figures; accepted by MNRAS
References in corpus (8)
- Revisiting the radio interferometer measurement equation. I. A full-sky Jones formalism
- Real-Time Calibration of the Murchison Widefield Array
- Non-linear Kalman filters for calibration in radio interferometry
- Revisiting the radio interferometer measurement equation. II. Calibration and direction-dependent effects
- The MeqTrees software system and its use for third-generation calibration of radio interferometers
- Fast gain calibration in radio astronomy using alternating direction implicit methods: Analysis and applications
- Revisiting the radio interferometer measurement equation. III. Addressing direction-dependent effects in 21 cm WSRT observations of 3C 147
- Robust Radio Interferometric Calibration Using the t-Distribution
Cited by in corpus (131)
- The LOFAR Two-metre Sky Survey - II. First data release
- The LOFAR Two-metre Sky Survey -- V. Second data release
- LOFAR facet calibration
- The LOFAR Two Meter Sky Survey: Deep Fields, I -- Direction-dependent calibration and imaging
- Faceting for direction-dependent spectral deconvolution
- Improved GRAVITY astrometric accuracy from modeling of optical aberrations
- CubiCal - Fast radio interferometric calibration suite exploiting complex optimisation
- Disk-jet coupling in the 2017/2018 outburst of the Galactic black hole candidate X-ray binary MAXI J1535-571
- LOFAR discovery of a 23.5-second radio pulsar
- The Planck clusters in the LOFAR sky. I. LoTSS-DR2: new detections and sample overview
- Sub-arcsecond imaging with the International LOFAR Telescope I. Foundational calibration strategy and pipeline
- The Radio Sky at Meter Wavelengths: m-Mode Analysis Imaging with the Owens Valley Long Wavelength Array
- The beautiful mess in Abell 2255
- Radio and X-ray observations of the luminous Fast Blue Optical Transient AT2020xnd
- Fast magnetic field amplification in distant galaxyclusters
- NGC 326: X-shaped no more
- First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
- Galaxy clusters enveloped by vast volumes of relativistic electrons
- The Coma cluster at LOFAR frequencies I: insights into particle acceleration mechanisms in the radio bridge
- A snapshot of the oldest AGN feedback phases
- Magnetic fields and relativistic electrons fill entire galaxy cluster
- Imaging Jupiter's radiation belts down to 127 MHz with LOFAR
- MeerKAT uncovers the physics of an Odd Radio Circle
- Cassiopeia A, Cygnus A, Taurus A, and Virgo A at ultra-low radio frequencies
- The ultra-steep diffuse radio emission observed in the cool-core cluster RX J1720.1+2638 with LOFAR at 54 MHz
- Extremely deep 150 MHz source counts from the LoTSS Deep Fields
- Physical insights from the spectrum of the radio halo in MACS J0717.5+3745
- Revived Fossil Plasma Sources in Galaxy Clusters
- Nearby galaxies in LoTSS-DR2: insights into the non-linearity of the radio-SFR relation
- HI 21cm Cosmology and the Bi-spectrum: Closure Diagnostics in Massively Redundant Interferometric Arrays
- Radio observations of the merging galaxy cluster system Abell 3391-Abell 3395
- MIGHTEE: Are giant radio galaxies more common than we thought?
- First constraints on the AGN X-ray luminosity function at from an eROSITA-detected quasar
- The galaxy group NGC 507: newly detected AGN remnant plasma transported by sloshing
- Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
- The contribution of discrete sources to the sky temperature at 144 MHz
- The LOFAR and JVLA view of the distant steep spectrum radio halo in MACS J1149.5+2223
- Constraining the AGN duty cycle in the cool-core cluster MS 0735.6+7421 with LOFAR data
- Radio fossils, relics, and haloes in Abell 3266: cluster archaeology with ASKAP-EMU and the ATCA
- LOFAR observations of the XMM-LSS field
- PUMA: The Positional Update and Matching Algorithm
- Observations of a Pre-Merger Shock in Colliding Clusters of Galaxies
- Understanding the radio relic emission in the galaxy cluster MACS J0717.5+3745: spectral analysis
- Non-convex optimization for self-calibration of direction-dependent effects in radio interferometric imaging
- Particle acceleration in a nearby galaxy cluster pair: the role of cluster dynamics
- Discovery of a Supercluster in the eROSITA Final Equatorial Depth Survey: X-ray Properties, Radio Halo, and Double Relics
- A giant radio bridge connecting two clusters in Abell 1758
- MIGHTEE: Deep 1.4 GHz Source Counts and the Sky Temperature Contribution of Star Forming Galaxies and Active Galactic Nuclei
- A MeerKAT-meets-LOFAR Study of MS 1455.0+2232: A 590 kiloparsec 'Mini'-Halo in a Sloshing Cool-Core Cluster
- MKT J170456.2-482100: the first transient discovered by MeerKAT
- A unique, ring-like radio source with quadrilateral structure detected with machine learning
- New constraints on the magnetic field in filaments of the cosmic web
- LOFAR high-band antenna observations of the Perseus cluster
- The eROSITA Final Equatorial-Depth Survey (eFEDS): LOFAR view of brightest cluster galaxies and AGN feedback
- A three-component giant radio halo: the puzzling case of the galaxy cluster Abell 2142
- The twisted jets of Circinus X-1
- Nonthermal phenomena in the center of Abell 1775: An 800 kpc head-tail, revived fossil plasma and slingshot radio halo
- Bayesian radio interferometric imaging with direction-dependent calibration
- Assessing the impact of two independent direction-dependent calibration algorithms on the LOFAR 21-cm signal power spectrum
- Faraday tomography of LoTSS-DR2 data: I. Faraday moments in the high-latitude outer Galaxy and revealing Loop III in polarisation
- Diffuse Radio Emission from Galaxy Clusters in the LOFAR Two-metre Sky Survey Deep Fields
- Walk on the Low Side: LOFAR explores the low-frequency radio emission of GASP jellyfish galaxies
- The great Kite in the sky: a LOFAR observation of the radio source in Abell 2626
- MERGHERS Pilot: MeerKAT discovery of diffuse emission in nine massive Sunyaev-Zel'dovich-selected galaxy clusters from ACT
- Sparse interferometric Stokes imaging under polarization constraint (Polarized SARA)
- A LOFAR view into the stormy environment of the galaxy cluster 2A0335+096
- LOFAR discovery of a radio halo in the high-redshift galaxy cluster PSZ2 G099.86+58.45
- Deep LOFAR 150 MHz imaging of the Boötes field: Unveiling the faint low-frequency sky
- The LOFAR Two Metre Sky Survey: Deep Fields. II. The ELAIS-N1 LOFAR deep field
- A MeerKAT-meets-LOFAR study of Abell 1413: a moderately disturbed non-cool-core cluster hosting a kpc 'mini'-halo
- Cygnus A jointly calibrated and imaged via non-convex optimisation from VLA data
- A MeerKAT Survey of Nearby Novalike Cataclysmic Variables
- Scalable precision wide-field imaging in radio interferometry: I. uSARA validated on ASKAP data
- Signatures from a merging galaxy cluster and its AGN population: LOFAR observations of Abell 1682
- On the variance of radio interferometric calibration solutions: Quality-based Weighting Schemes
- Late-Time Evolution and Modeling of the Off-Axis Gamma-ray Burst Candidate FIRST J141918.9+394036
- MeerKAT discovery of radio emission from the Vela X-1 bow shock
- Abell 1430: A merging cluster with exceptional diffuse radio emission
- Probabilistic direction-dependent ionospheric calibration for LOFAR-HBA
- LOFAR Deep Fields: Probing a broader population of polarized radio galaxies in ELAIS-N1
- An Eigenvector-based Method of Radio Array Calibration and Its Application to the Tianlai Cylinder Pathfinder
- LOFAR Detection of a Low-Power Radio Halo in the Galaxy Cluster Abell 990
- Barbell-shaped giant radio galaxy with ~100 kpc kink in the jet
- Low-frequency radio absorption in Tycho's supernova remnant
- Radio Burst from a Stellar Coronal Mass Ejection
- The LOFAR Two-metre Sky Survey: Deep Fields Data Release 2. I. The ELAIS-N1 field
- LEAP: An Innovative Direction Dependent Ionospheric Calibration Scheme for Low Frequency Arrays
- Redundant interferometric calibration as a complex optimization problem
- The LOFAR LBA Sky Survey: Deep Fields I. The Boötes Field
- LOFAR 144-MHz follow-up observations of GW170817
- Mining Mini-Halos with MeerKAT I. Calibration and Imaging
- Limits and challenges of the detection of cluster-scale diffuse radio emission at high redshift: The Massive and Distant Clusters of WISE Survey (MaDCoWS) in LoTSS-DR2
- Differences in radio emission from similar M dwarfs in the binary system Ross 867-8
- Characterising the extended morphologies of BL Lacs at 144 MHz with LOFAR
- New filamentary remnant radio emission and duty cycle constraints in the radio galaxy NGC 6086
- A new pulsar candidate in 47 Tucanae discovered with MeerKAT imaging
- AGN feedback in an infant galaxy cluster: the LOFAR-Chandra view of the giant FRII radio galaxy J103025+052430 at z=1.7
- First upper limits on the 21-cm signal power spectrum of neutral hydrogen at from the LOFAR 3C196 field
- Accuracy vs. Complexity: Calibrating radio interferometer arrays with non-homogeneous element patterns
- The MeerKAT Massive Distant Clusters Survey: detection of diffuse radio emission in galaxy clusters at
- The significance of low frequency interferometric observations for the GPS pulsar flux estimation: the case of J1740+1000
- Searching for low radio-frequency gravitational wave counterparts in wide-field LOFAR data
- Detection of coherent low-frequency radio bursts from weak-line TTauri stars
- Pipeline Collector: gathering performance data for distributed astronomical pipelines
- The twisted jets and magnetic fields of the extended radio galaxy 4C 70.19
- Design, operation and performance of the PAON4 prototype transit interferometer
- Calibration artefacts in radio interferometry. III. Phase-only calibration and primary beam correction
- Spectral study of the diffuse synchrotron source in the galaxy cluster Abell 523
- Revealing the intricacies of radio galaxies and filaments in the merging galaxy cluster Abell 2255. I. Insights from deep LOFAR-VLBI sub-arcsecond resolution images
- Decoherence in LOFAR-VLBI Beamforming
- Robust direction-dependent gain-calibration of beam-modelling errors far from the target field
- Radio-FIR correlation- A probe into cosmic ray propagation in the nearby galaxy IC 342
- Pulsar B1237+25 Aberration/Retardation Analysis from Decimeter to Decameter Wavelength: Challenge to "Radius-to-Frequency Mapping"
- A circularly polarized low-frequency radio burst from the exoplanetary system HD 189733
- Relighting the fire in Hickson Compact Group (HCG) 15: magnetised fossil plasma revealed by the SKA Pathfinders & Precursors
- A Matched Survey for the Enigmatic Low Radio Frequency Transient ILT J225347+862146
- Scalability Model for the LOFAR Direction Independent Pipeline
- SN 1885A and supernova remnants in the centre of M31 with LOFAR
- Combined LOFAR-uGMRT analysis of the diffuse radio emission in the massive clusters Abell 773 and Abell 1351
- The LOFAR sub-arcsecond view of the high-redshift radio relic in PSZ2G091.83+26.11
- Fast and Reproducible LOFAR Workflows with AGLOW
- Pilot study and early results of the Cosmic Filaments and Magnetism Survey with Nenufar: the Coma cluster field
- A deep study of A399-401: An application for wide-field facet calibration
- MOSS I: Double radio relics in the Saraswati supercluster
- MIGHTEE: total intensity radio continuum imaging and the COSMOS / XMM-LSS Early Science fields
- An Introduction to Single-Antenna Radio Astronomical Polarimetry
- The MeerKAT Massive Distant Clusters Survey: a search for diffuse radio emission in 30 massive SZ-selected clusters at
- Are Stellar Embryos in Perseus Radio-Synchrotron Emitters? Statistical data analysis with Herschel and LOFAR paving the way for the SKA
- Third-Generation Calibrations for MeerKAT observation
- A LOFAR-uGMRT spectral index study of distant radio halos
- Spectral analysis of spatially-resolved 3C295 (sub-arcsecond resolution) with the International LOFAR Telescope