Systematic effects in LOFAR data: A unified calibration strategy

Abstract

Context: New generation low-frequency telescopes are exploring a new parameter space in terms of depth and resolution. The data taken with these interferometers, for example with the LOw Frequency ARray (LOFAR), are often calibrated in a low signal-to-noise ratio regime and the removal of critical systematic effects is challenging. The process requires an understanding of their origin and properties. Aim: In this paper we describe the major systematic effects inherent to next generation low-frequency telescopes, such as LOFAR. With this knowledge, we introduce a data processing pipeline that is able to isolate and correct these systematic effects. The pipeline will be used to calibrate calibrator observations as the first step of a full data reduction process. Methods: We processed two LOFAR observations of the calibrator 3C196: the first using the Low Band Antenna (LBA) system at 42-66 MHz and the second using the High Band Antenna (HBA) system at 115-189 MHz. Results: We were able to isolate and correct for the effects of clock drift, polarisation misalignment, ionospheric delay, Faraday rotation, ionospheric scintillation, beam shape, and bandpass. The designed calibration strategy produced the deepest image to date at 54 MHz. The image has been used to confirm that the spectral energy distribution of the average radio source population tends to flatten at low frequencies. Conclusions: We prove that LOFAR systematic effects can be described by a relatively small number of parameters. Furthermore, the identification of these parameters is fundamental to reducing the degrees of freedom when the calibration is carried out on fields that are not dominated by a strong calibrator.

20 pages, 15 figures. This paper is part of the LOFAR surveys data release 1 and has been accepted for publication in a special edition of A&A that will appear in Feb 2019, volume 622. The catalogues and images from the data release will be publicly available on lofar-surveys.org upon publication of the journal

References in corpus (22)

• Astrophysics Source Code Library
• WSClean: an implementation of a fast, generic wide-field imager for radio astronomy
• The LOFAR Two-metre Sky Survey - I. Survey Description and Preliminary Data Release
• The LOFAR Two-metre Sky Survey - II. First data release
• GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey I: A low-frequency extragalactic catalogue
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• The Very Large Array Low-frequency Sky Survey Redux (VLSSr)
• Revisiting the radio interferometer measurement equation. I. A full-sky Jones formalism
• Faceting for direction-dependent spectral deconvolution
• The LoTSS view of radio AGN in the local Universe. The most massive galaxies are always switched on
• Real-Time Calibration of the Murchison Widefield Array
• Revisiting the radio interferometer measurement equation. II. Calibration and direction-dependent effects
• A radio spectral index map and catalogue at 147-1400 MHz covering 80 per cent of the sky
• Gentle re-energisation of electrons in merging galaxy clusters
• Deep LOFAR observations of the merging galaxy cluster CIZA J2242.8+5301
• The effect of the ionosphere on ultra-low frequency radio-interferometric observations
• Discovery of a radio galaxy at z = 5.72
• Fast gain calibration in radio astronomy using alternating direction implicit methods: Analysis and applications
• 325-MHz observations of the ELAIS-N1 field using the Giant Metrewave Radio Telescope
• LOFAR low-band antenna observations of the 3C295 and Bootes fields: source counts and ultra-steep spectrum sources
• Discovery of Carbon Radio Recombination Lines in M82
• The first detection of radio recombination lines at cosmological distances

Cited by in corpus (144)

• The LOFAR Two-metre Sky Survey - II. First data release
• The LOFAR Two-metre Sky Survey -- V. Second data release
• The LOFAR Two Meter Sky Survey: Deep Fields, I -- Direction-dependent calibration and imaging
• LOFAR observations of galaxy clusters in HETDEX
• The LOFAR Two Metre Sky Survey: Deep Fields Data Release 1 -- III. Host-galaxy identifications and value added catalogues
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• The LOFAR LBA Sky Survey I. survey description and preliminary data release
• The Planck clusters in the LOFAR sky. I. LoTSS-DR2: new detections and sample overview
• Sub-arcsecond imaging with the International LOFAR Telescope I. Foundational calibration strategy and pipeline
• New constraints on the magnetization of the cosmic web using LOFAR Faraday rotation observations
• A LOFAR study of non-merging massive galaxy clusters
• Fast magnetic field amplification in distant galaxyclusters
• Galaxy clusters enveloped by vast volumes of relativistic electrons
• Radio observations of the merging galaxy cluster Abell 520
• ASTRI Mini-Array Core Science at the Observatorio del Teide
• A snapshot of the oldest AGN feedback phases
• Magnetic fields and relativistic electrons fill entire galaxy cluster
• Extremely deep 150 MHz source counts from the LoTSS Deep Fields
• Cassiopeia A, Cygnus A, Taurus A, and Virgo A at ultra-low radio frequencies
• The ultra-steep diffuse radio emission observed in the cool-core cluster RX J1720.1+2638 with LOFAR at 54 MHz
• Physical insights from the spectrum of the radio halo in MACS J0717.5+3745
• Intracluster magnetic filaments and an encounter with a radio jet
• Revived Fossil Plasma Sources in Galaxy Clusters
• Deep sub-arcsecond widefield imaging of the Lockman Hole field at 144 MHz
• First constraints on the AGN X-ray luminosity function at $z\sim 6$ from an eROSITA-detected quasar
• The galaxy group NGC 507: newly detected AGN remnant plasma transported by sloshing
• The LOFAR LBA Sky Survey II. First data release
• The LOFAR and JVLA view of the distant steep spectrum radio halo in MACS J1149.5+2223
• Discovering the most elusive radio relic in the sky: Diffuse Shock Acceleration caught in the act?
• LOFAR observations of the XMM-LSS field
• Understanding the radio relic emission in the galaxy cluster MACS J0717.5+3745: spectral analysis
• Particle acceleration in a nearby galaxy cluster pair: the role of cluster dynamics
• Discovery of a Supercluster in the eROSITA Final Equatorial Depth Survey: X-ray Properties, Radio Halo, and Double Relics
• Calibrating the relation of low-frequency radio continuum to star formation rate at 1 kpc scale with LOFAR
• Patterns of primary beam non-redundancy in close-packed 21 cm array observations
• A MeerKAT-meets-LOFAR Study of MS 1455.0+2232: A 590 kiloparsec 'Mini'-Halo in a Sloshing Cool-Core Cluster
• CHANG-ES XII: A LOFAR and VLA view of the edge-on star-forming galaxy NGC 3556
• New constraints on the magnetic field in filaments of the cosmic web
• Abell 1033: Radio halo and gently reenergized tail at 54 MHz
• LOFAR high-band antenna observations of the Perseus cluster
• Measuring cavity powers of active galactic nuclei in clusters using a hybrid X-ray-radio method -- A new window on feedback opened by subarcsecond LOFAR-VLBI observations
• The eROSITA Final Equatorial-Depth Survey (eFEDS): LOFAR view of brightest cluster galaxies and AGN feedback
• Ultra-steep spectrum emission in the merging galaxy cluster Abell 1914
• Evolutionary phases of merging clusters as seen by LOFAR
• A three-component giant radio halo: the puzzling case of the galaxy cluster Abell 2142
• Can we detect aurora in exoplanets orbiting M dwarfs?
• Origin of the ring structures in Hercules A -- Sub-arcsecond 144 MHz to 7 GHz observations
• Radio Observations of HD80606 Near Planetary Periastron: II. LOFAR Low Band Antenna Observations at 30-78 MHz
• Nonthermal phenomena in the center of Abell 1775: An 800 kpc head-tail, revived fossil plasma and slingshot radio halo
• The TESS View of LOFAR Radio-Emitting Stars
• Faraday tomography of LoTSS-DR2 data: I. Faraday moments in the high-latitude outer Galaxy and revealing Loop III in polarisation
• Walk on the Low Side: LOFAR explores the low-frequency radio emission of GASP jellyfish galaxies
• Data Processing Pipeline For Tianlai Experiment
• Characterizing the radio emission from the binary galaxy cluster merger Abell 2146
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• The great Kite in the sky: a LOFAR observation of the radio source in Abell 2626
• Unmasking the history of 3C 293 with LOFAR sub-arcsecond imaging
• Radio relics in PSZ2 G096.88+24.18: A connection with pre-existing plasma
• LOFAR discovery of a radio halo in the high-redshift galaxy cluster PSZ2 G099.86+58.45
• Particle re-acceleration and diffuse radio sources in the galaxy cluster Abell 1550
• A LOFAR view into the stormy environment of the galaxy cluster 2A0335+096
• The LOFAR Two Metre Sky Survey: Deep Fields. II. The ELAIS-N1 LOFAR deep field
• Discovery of a radio halo (and relic) in a $M_{500}<2\times 10^{14}$ M${}_{\odot }$ cluster
• Diffuse radio emission from non-Planck galaxy clusters in the LoTSS-DR2 fields
• ViCTORIA project: The LOFAR HBA Virgo Cluster Survey
• The first detection of radio recombination lines at cosmological distances
• The ROAD to discovery: machine learning-driven anomaly detection in radio astronomy spectrograms
• Investigating ionospheric calibration for LOFAR 2.0 with simulated observations
• The prototypical major cluster merger Abell 754. I. Calibration of MeerKAT data and radio/X-ray spectral mapping of the cluster
• Filamentary structures of ionized gas in Cygnus X
• Late-Time Evolution and Modeling of the Off-Axis Gamma-ray Burst Candidate FIRST J141918.9+394036
• Pushing subarcsecond resolution imaging down to 30 MHz with the trans-European International LOFAR Telescope
• Probabilistic direction-dependent ionospheric calibration for LOFAR-HBA
• A low frequency sub-arcsecond view of powerful radio galaxies in rich-cluster environments: 3C 34 and 3C 320
• LOFAR Deep Fields: Probing a broader population of polarized radio galaxies in ELAIS-N1
• Measurement of the Anisotropy Power Spectrum of the Radio Synchrotron Background
• LOFAR Detection of a Low-Power Radio Halo in the Galaxy Cluster Abell 990
• LOFAR observations of radio burst source sizes and scattering in the solar corona
• The spectacular cluster chain Abell 781 as observed with LOFAR, GMRT, and XMM-Newton
• Barbell-shaped giant radio galaxy with ~100 kpc kink in the jet
• The LOFAR Two-metre Sky Survey: Deep Fields Data Release 2. I. The ELAIS-N1 field
• Low-frequency radio absorption in Tycho's supernova remnant
• Warped diffusive radio halo around the quiescent spiral edge-on galaxy NGC 4565
• A search for inter-cluster filaments with LOFAR and eROSITA
• The LOFAR LBA Sky Survey: Deep Fields I. The Boötes Field
• Low-frequency radio observations of recurrent nova RS Ophiuchi with MeerKAT and LOFAR
• Diffusion of cosmic-ray electrons in M 51 observed with LOFAR at 54 MHz
• LOFAR 144-MHz follow-up observations of GW170817
• Limits and challenges of the detection of cluster-scale diffuse radio emission at high redshift: The Massive and Distant Clusters of WISE Survey (MaDCoWS) in LoTSS-DR2
• VLBI Imaging of high-redshift galaxies and protoclusters at low radio frequencies with the International LOFAR Telescope
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Probing particle acceleration in Abell 2256: from to 16 MHz to gamma rays
• LOFAR Deep Fields: Probing faint Galactic polarised emission in ELAIS-N1
• Differences in radio emission from similar M dwarfs in the binary system Ross 867-8
• Reaching thermal noise at ultra-low radio frequencies: the Toothbrush radio relic downstream of the shock front
• Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
• 1-arcsecond imaging of ELAIS-N1 field at 144MHz using the LoTSS survey with international LOFAR telescope
• Seeing the forest and the trees: a radio investigation of the ULIRG Mrk 273
• New filamentary remnant radio emission and duty cycle constraints in the radio galaxy NGC 6086
• Searching for the largest bound atoms in space
• Diffuse Sources, Clustering and the Excess Anisotropy of the Radio Synchrotron Background
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• AGN feedback in an infant galaxy cluster: the LOFAR-Chandra view of the giant FRII radio galaxy J103025+052430 at z=1.7
• Searching for low radio-frequency gravitational wave counterparts in wide-field LOFAR data
• The twisted jets and magnetic fields of the extended radio galaxy 4C 70.19
• Monster radio jet (>66 kpc) observed in quasar at z$\sim$5
• Resolving spatial and temporal shock structures using LOFAR observations of type II radio bursts
• Subarcsecond view on the high-redshift blazar GB 1508+5714 by the International LOFAR Telescope
• The significance of low frequency interferometric observations for the GPS pulsar flux estimation: the case of J1740+1000
• Detection of coherent low-frequency radio bursts from weak-line TTauri stars
• Spectral study of the diffuse synchrotron source in the galaxy cluster Abell 523
• Abell 0399-Abell 0401 radio bridge spectral index: the first multifrequency detection
• LOFAR observations of gravitational wave merger events: O3 results and O4 strategy
• Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study with the Hydrogen Epoch of Reionization Array
• High-resolution imaging with the International LOFAR Telescope: Observations of the gravitational lenses MG 0751+2716 and CLASS B1600+434
• Robust direction-dependent gain-calibration of beam-modelling errors far from the target field
• The ViCTORIA project: description of a multi-frequency radio survey of the Virgo galaxy cluster
• A LOFAR prompt search for radio emission accompanying X-ray flares in GRB 210112A
• Determining the acceleration regions of in situ electrons using remote radio and X-ray observations
• Strong low-frequency radio flaring from Cygnus X-3 observed with LOFAR
• Revealing the intricacies of radio galaxies and filaments in the merging galaxy cluster Abell 2255. I. Insights from deep LOFAR-VLBI sub-arcsecond resolution images
• Constraints on the magnetic field in the inter-cluster bridge A399-A401
• The first high-redshift cavity power measurements of cool-core galaxy clusters with the International LOFAR Telescope
• Tied-array holography with LOFAR
• Non-thermal emission in galaxy groups at extremely low frequency: the case of A1213
• New supernova remnant candidates in the LOFAR Two Metre Sky Survey
• SN 1885A and supernova remnants in the centre of M31 with LOFAR
• LOFAR non-detections of SN 2023ixf in its first year post-explosion
• Probing Equatorial Ionospheric TEC at Sub-GHz Frequencies with Wide-Band (B4) uGMRT Interferometric Data
• The Crab Nebula at subarcsecond resolution with the International LOFAR Telescope
• LOFAR 58 MHz Legacy Survey of the 3CRR Catalog
• Combined LOFAR-uGMRT analysis of the diffuse radio emission in the massive clusters Abell 773 and Abell 1351
• The LOFAR sub-arcsecond view of the high-redshift radio relic in PSZ2G091.83+26.11
• Realising the LOFAR Two-Metre Sky Survey -- using the supercomputer JUWELS at the Forschungszentrum Jülich
• An improved algorithm for separating clock delays from ionospheric effects in radio astronomy
• A deep study of A399-401: An application for wide-field facet calibration
• Lossless compression of simulated radio interferometric visibilities
• Are Stellar Embryos in Perseus Radio-Synchrotron Emitters? Statistical data analysis with Herschel and LOFAR paving the way for the SKA
• A LOFAR-uGMRT spectral index study of distant radio halos
• Mapping the emission and spectral properties of the FRI radio galaxy 3C 449 with LOFAR and the VLA
• Evidence for cold plasma in planetary nebulae from radio observations with the LOw Frequency ARray (LOFAR)
• Spectral analysis of spatially-resolved 3C295 (sub-arcsecond resolution) with the International LOFAR Telescope
• The resolved jet of 3C 273 at 150 MHz
• An Introduction to Single-Antenna Radio Astronomical Polarimetry