Standardised formats and open-source analysis tools for the MAGIC telescopes data

Abstract

Instruments for gamma-ray astronomy at Very High Energies ($E>100\mathrm{GeV}$) have traditionally derived their scientific results through proprietary data and software. Data standardisation has become a prominent issue in this field both as a requirement for the dissemination of data from the next generation of gamma-ray observatories and as an effective solution to realise public data legacies of current-generation instruments. Specifications for a standardised gamma-ray data format have been proposed as a community effort and have already been successfully adopted by several instruments. We present the first production of standardised data from the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes. We converted $166\mathrm{h}$ of observations from different sources and validated their analysis with the open-source software Gammapy. We consider six data sets representing different scientific and technical analysis cases and compare the results obtained analysing the standardised data with open-source software against those produced with the MAGIC proprietary data and software. Aiming at a systematic production of MAGIC data in this standardised format, we also present the implementation of a database-driven pipeline automatically performing the MAGIC data reduction from the calibrated down to the standardised data level. In all the cases selected for the validation, we obtain results compatible with the MAGIC proprietary software, both for the manual and for the automatic data productions. Part of the validation data set is also made publicly available, thus representing the first large public release of MAGIC data. This effort and this first data release represent a technical milestone toward the realisation of a public MAGIC data legacy.

Accepted for publication in the Journal of High Energy Astrophysics

References in corpus (22)

• Extragalactic Background Light Inferred from AEGIS Galaxy SED-type Fractions
• The major upgrade of the MAGIC telescopes, Part II: A performance study using observations of the Crab Nebula
• Gamma-ray flares from the Crab Nebula
• Fermi-LAT Observations of Markarian 421: the Missing Piece of its Spectral Energy Distribution
• Background Modelling in Very-High-Energy gamma-ray Astronomy
• Discovery of Powerful Gamma-Ray Flares from the Crab Nebula
• The surprising Crab pulsar and its nebula: A review
• Implementation of the Random Forest Method for the Imaging Atmospheric Cherenkov Telescope MAGIC
• Black hole lightning due to particle acceleration at subhorizon scales
• Unfolding of differential energy spectra in the MAGIC experiment
• Gammapy: A Python package for gamma-ray astronomy
• Detection of very high energy gamma-ray emission from the gravitationally-lensed blazar QSO B0218+357 with the MAGIC telescopes
• Ground-based detectors in very-high-energy gamma-ray astronomy
• GammaLib and ctools: A software framework for the analysis of astronomical gamma-ray data
• Performance of the MAGIC telescopes under moonlight
• Redshift-distance Survey of Early-type Galaxies: the ENEARc Cluster Sample
• Towards open and reproducible multi-instrument analysis in gamma-ray astronomy
• The Redshift of the Lensed Object in the Einstein Ring B0218+357
• Unravelling the complex behavior of Mrk 421 with simultaneous X-ray and VHE observations during an extreme flaring activity in April 2013
• Validation of open-source science tools and background model construction in $\gamma$-ray astronomy
• Deep observations of the globular cluster M15 with the MAGIC telescopes
• Analysis of the H.E.S.S. public data release with ctools