SDHDF: A new file format for spectral-domain radio astronomy data

Abstract

Radio astronomy file formats are now required to store wide frequency bandwidths and multiple simultaneous receiver beams and must be able to account for versatile observing modes and numerous calibration strategies. The need to capture and archive high-time and high frequency-resolution data, along with the comprehensive metadata that fully describe the data, implies that a new data format and new processing software are required. This requirement is suited to a well-defined, hierarchically-structured and flexible file format. In this paper we present the Spectral-Domain Hierarchical Data Format (`SDHDF') -- a new file format for radio astronomy data, in particular for single dish or beam-formed data streams. Since 2018, SDHDF has been the primary format for data products from the spectral-line and continuum observing modes at Murriyang, the CSIRO Parkes 64-m radio telescope, and we demonstrate that this data format can also be used to store observations of pulsars and fast radio bursts.

arXiv commentSupplementary material (SDHDF definition): https://ars.els-cdn.com/content/image/1-s2.0-S2213133724000192-mmc1.pdf

References in corpus (10)

• LOFAR: The LOw-Frequency ARray
• A bright millisecond radio burst of extragalactic origin
• PSRCHIVE and PSRFITS An Open Approach to Radio Pulsar Data Storage and Analysis
• GASS: The Parkes Galactic All-Sky Survey. I. Survey Description, Goals, and Initial Data Release
• An ultra-wide bandwidth (704 to 4032 MHz) receiver for the Parkes radio telescope
• The PULSE@Parkes project: A new observing technique for long-term pulsar monitoring
• Learning from FITS: Limitations in use in modern astronomical research
• HIPSR: A Digital Signal Processor for the Parkes 21-cm Multibeam Receiver
• Parkes full polarization spectra of OH masers - II. Galactic longitudes 240 to 350
• HDFITS: porting the FITS data model to HDF5