Hierarchical progressive surveys. Multi-resolution HEALPix data structures for astronomical images, catalogues, and 3-dimensional data cubes

Abstract

Scientific exploitation of the ever increasing volumes of astronomical data requires efficient and practical methods for data access, visualisation, and analysis. Hierarchical sky tessellation techniques enable a multi-resolution approach to organising data on angular scales from the full sky down to the individual image pixels. Aims. We aim to show that the Hierarchical progressive survey (HiPS) scheme for describing astronomical images, source catalogues, and three-dimensional data cubes is a practical solution to managing large volumes of heterogeneous data and that it enables a new level of scientific interoperability across large collections of data of these different data types. Methods. HiPS uses the HEALPix tessellation of the sphere to define a hierarchical tile and pixel structure to describe and organise astronomical data. HiPS is designed to conserve the scientific properties of the data alongside both visualisation considerations and emphasis on the ease of implementation. We describe the development of HiPS to manage a large number of diverse image surveys, as well as the extension of hierarchical image systems to cube and catalogue data. We demonstrate the interoperability of HiPS and Multi-Order Coverage (MOC) maps and highlight the HiPS mechanism to provide links to the original data. Results. Hierarchical progressive surveys have been generated by various data centres and groups for ~200 data collections including many wide area sky surveys, and archives of pointed observations. These can be accessed and visualised in Aladin, Aladin Lite, and other applications. HiPS provides a basis for further innovations in the use of hierarchical data structures to facilitate the description and statistical analysis of large astronomical data sets.

21 pages, 6 figures. Accepted for publication in Astronomy & Astrophysics

References in corpus (47)

• The Wide-field Infrared Survey Explorer (WISE): Mission Description and Initial On-orbit Performance
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• The Seventh Data Release of the Sloan Digital Sky Survey
• The Large Area Telescope on the Fermi Gamma-ray Space Telescope Mission
• The Spitzer Space Telescope Mission
• LOFAR: The LOw-Frequency ARray
• The Galaxy Evolution Explorer: A Space Ultraviolet Survey Mission
• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Final Maps and Results
• The SIMBAD astronomical database
• The Milky Way in Molecular Clouds: A New Complete CO Survey
• The Great Observatories Origins Deep Survey: Initial Results From Optical and Near-Infrared Imaging
• The VizieR database of Astronomical Catalogues
• The Ninth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the SDSS-III Baryon Oscillation Spectroscopic Survey
• GLIMPSE: I. A SIRTF Legacy Project to Map the Inner Galaxy
• SINGS: The SIRTF Nearby Galaxies Survey
• CALIFA, the Calar Alto Legacy Integral Field Area survey: I. Survey presentation
• GAIA: Composition, Formation and Evolution of the Galaxy
• The Infrared Astronomical Mission AKARI
• SUMSS: A Wide-Field Radio Imaging Survey of the Southern Sky. II. The Source Catalogue
• UltraVISTA: a new ultra-deep near-infrared survey in COSMOS
• SCUBA: A common-user submillimetre camera operating on the James Clerk Maxwell Telescope
• The AKARI/IRC Mid-Infrared All-Sky Survey
• SCUBA-2: The 10000 pixel bolometer camera on the James Clerk Maxwell Telescope
• The Chandra Source Catalog
• A Full-Sky H-alpha Template for Microwave Foreground Prediction
• IRIS: A new generation of IRAS maps
• A Robotic Wide-Angle H-Alpha Survey of the Southern Sky
• The VLA Galactic Plane Survey
• The SCUBA Legacy Catalogue: Continuum Objects Detected by SCUBA
• GASS: The Parkes Galactic All-Sky Survey. I. Survey Description, Goals, and Initial Data Release
• The Aao/Ukst Supercosmos H-alpha Survey (SHS)
• The Bolocam Galactic Plane Survey: Survey Description and Data Reduction
• CALIFA, the Calar Alto Legacy Integral Field Area survey. II. First public data release
• The Molonglo Galactic Plane Survey (MGPS-2): Compact Source Catalogue
• CALIFA, the Calar Alto Legacy Integral Field Area survey. III. Second public data release
• Surveying the Agents of Galaxy Evolution in the Tidally-Stripped, Low Metallicity Small Magellanic Cloud (SAGE-SMC). I. Overview
• Gaia Universe Model Snapshot : A statistical analysis of the expected contents of the Gaia catalogue
• PPM-Extended (PPMX) - a catalogue of positions and proper motions
• INTEGRAL/IBIS nine-year Galactic Hard X-Ray Survey
• Dark gas in the solar neighnorhood from extinction data
• A New 1.4GHz Radio Continuum Map of the Sky South of Declination +25 deg
• A Full-sky, High-resolution Atlas of Galactic 12 micron Dust Emission with WISE
• Scientific Visualization in Astronomy: Towards the Petascale Astronomy Era
• VLSS Redux: Software Improvements applied to the Very Large Array Low-frequency Sky Survey
• Star-galaxy separation by far-infrared color-color diagrams for the AKARI FIS All-Sky Survey (Bright Source Catalogue Version beta-1)
• Catalog Matching with Astrometric Correction and its Application to the Hubble Legacy Archive
• Data compression on the sphere

Cited by in corpus (34)

• The LOFAR Two-metre Sky Survey -- V. Second data release
• The XMM-Newton serendipitous survey IX. The fourth XMM-Newton serendipitous source catalogue
• The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
• The Rapid ASKAP Continuum Survey Paper II: First Stokes I Source Catalogue Data Release
• Photometric redshift estimation via deep learning
• VISION - Vienna survey in Orion I. VISTA Orion A Survey
• XRBcats: Galactic Low Mass X-ray Binary Catalogue
• Characterization of Low Surface Brightness structures in annotated deep images
• The Gravitational Wave Treasure Map: A Tool to Coordinate, Visualize, and Assess the Electromagnetic Follow-Up of Gravitational Wave Events
• VESPA: a community-driven Virtual Observatory in Planetary Science
• Return of the features. Efficient feature selection and interpretation for photometric redshifts
• The Application of the Montage Image Mosaic Engine To The Visualization Of Astronomical Images
• Search for globular clusters associated with the Milky Way dwarf galaxies using Gaia DR2
• Visualisation of Multi-mission Astronomical Data with ESASky
• Active deep learning method for the discovery of objects of interest in large spectroscopic surveys
• ESASky : A Science-Driven Discovery Portal for Space-Based Astronomy Missions
• Runaways and shells around the CMa OB1 association
• The Vera C. Rubin Observatory Data Preview 1
• HEALPix Alchemy: Fast All-Sky Geometry and Image Arithmetic in a Relational Database for Multimessenger Astronomy Brokers
• The surface of (1) Ceres in visible light as seen by Dawn/VIR
• nazgul: A statistical approach to gamma-ray burst localization. Triangulation via non-stationary time-series models
• Low Surface Brightness structures from annotated deep CFHT images: effects of the host galaxy's properties and environment
• ESASky SSOSS: Solar System Object Search Service and the case of Psyche
• Multi-Resolution HEALPix Maps for Multi-Wavelength and Multi-Messenger Astronomy
• STRRINGS: STReams in Residual Images of Nearby GalaxieS
• Efficient data structures for masks on 2D grids
• AstroInspect: a web-based system to organize, assess, and visually inspect astronomical objects
• The surface of (4) Vesta in visible light as seen by Dawn/VIR
• gamma-sky.net: Portal to the Gamma-Ray Sky
• Encapsulating Textual Contents into a MOC data Structure for Advanced Applications
• The FAST Hundred-Deg${}^2$ HI Deep (HD${}^2$) Survey: Early Results from the Pilot Survey
• Precision Analysis of ${}^{12}\mathrm{C}{/}^{13}\mathrm{C}$ Ratios in Orion IRc2 Acetylene Isotopologues via ${\chi }^2$ Fitting
• Skykatana: a scalable framework to construct sky masks for the Vera Rubin Observatory and large astronomical surveys
• Galaxy clusters in the LoTSS-DR3: Catalogues and detection pipeline for diffuse radio emission