Astronomical Data Formats: What we have and how we got here
arXiv:1507.03646 · doi:10.1016/j.ascom.2015.07.001
Abstract
Despite almost all being acquired as photons, astronomical data from different instruments and at different stages in its life may exist in different formats to serve different purposes. Beyond the data itself, descriptive information is associated with it as metadata, either included in the data format or in a larger multi-format data structure. Those formats may be used for the acquisition, processing, exchange, and archiving of data. It has been useful to use similar formats, or even a single standard to ease interaction with data in its various stages using familiar tools. Knowledge of the evolution and advantages of present standards is useful before we discuss the future of how astronomical data is formatted. The evolution of the use of world coordinates in FITS is presented as an example.
arXiv commentaccepted by Astronomy and Computing
References in corpus (8)
- Representations of world coordinates in FITS
- The NASA Astrophysics Data System: Overview
- Improved Photometry for the DASCH Pipeline
- Learning from 25 years of the extensible N-Dimensional Data Format
- Learning from FITS: Limitations in use in modern astronomical research
- Reimplementing the Hierarchical Data System using HDF5
- The Past, Present and Future of Astronomical Data Formats
- Significant problems in FITS limit its use in modern astronomical research
Cited by in corpus (6)
- Learning from FITS: Limitations in use in modern astronomical research
- HDFITS: porting the FITS data model to HDF5
- The Case For Alternative Web Archival Formats To Expedite The Data-To-Insight Cycle
- From Data Processes to Data Products: Knowledge Infrastructures in Astronomy
- Datatractor: Metadata, automation, and registries for extractor interoperability in the chemical and materials sciences
- The General Single-Dish Data Format: A Retrospective