Learning from FITS: Limitations in use in modern astronomical research
arXiv:1502.00996 · doi:10.1016/j.ascom.2015.01.009
Abstract
The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.
References in corpus (16)
- Astropy: A Community Python Package for Astronomy
- LOFAR: The LOw-Frequency ARray
- The VizieR database of Astronomical Catalogues
- The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
- PSRCHIVE and PSRFITS An Open Approach to Radio Pulsar Data Storage and Analysis
- SCUBA-2: The 10000 pixel bolometer camera on the James Clerk Maxwell Telescope
- Representations of celestial coordinates in FITS
- Representations of world coordinates in FITS
- Representations of spectral coordinates in FITS
- APECS - The Atacama Pathfinder Experiment Control System
- Lossless Astronomical Image Compression and the Effects of Noise
- Learning from 25 years of the extensible N-Dimensional Data Format
- Reimplementing the Hierarchical Data System using HDF5
- HDFITS: porting the FITS data model to HDF5
- Astronomical Data Formats: What we have and how we got here
- Observatory/data centre partnerships and the VO-centric archive: The JCMT Science Archive experience
Cited by in corpus (10)
- Learning from 25 years of the extensible N-Dimensional Data Format
- Reimplementing the Hierarchical Data System using HDF5
- HDFITS: porting the FITS data model to HDF5
- AST: A library for modelling and manipulating coordinate systems
- The Case For Alternative Web Archival Formats To Expedite The Data-To-Insight Cycle
- Astronomical Data Formats: What we have and how we got here
- Once FITS, Always FITS? Astronomical Infrastructure in Transition
- The General Single-Dish Data Format: A Retrospective
- SDHDF: A new file format for spectral-domain radio astronomy data
- Adaptive Optics Telemetry Standard: Design and specification of a novel data exchange format