Signal discovery, limits, and uncertainties with sparse On/Off measurements: an objective Bayesian analysis

Abstract

For decades researchers have studied the On/Off counting problem, where a measured rate consists of two parts. One due to a signal process and another due to a background process, of which both magnitudes are unknown. While most frequentist methods are adequate for large count numbers, they cannot be applied to sparse data. Here I want to present a new objective Bayesian solution that only depends on three parameters: the number of events in the signal region, the number of events in the background region, and the ratio of the exposure for both regions. First, the probability of the hypothesis that the counts are due to background only is derived analytically. Second, the marginalized posterior for the signal parameter is also derived analytically. With this two-step approach it is easy to calculate the signal's significance, strength, uncertainty, or upper limit in a unified way. The approach is valid without restrictions for any count number including zero and may be widely applied in particle physics, cosmic-ray physics and high-energy astrophysics. In order to demonstrate its performance I apply the method to gamma-ray burst data.

18 pages, 10 figures, accepted for publication in ApJ

References in corpus (3)

• Results on neutrinoless double beta decay of 76Ge from GERDA Phase I
• Background Modelling in Very-High-Energy gamma-ray Astronomy
• Evaluation of three methods for calculating statistical significance when incorporating a systematic uncertainty into a test of the background-only hypothesis for a Poisson process

Cited by in corpus (16)

• The double Blue Straggler sequence in NGC2173: a field contamination artefact
• No evidence for younger stellar generations within the intermediate age massive clusters NGC 1783, NGC 1696 and NGC 411
• Disentangling Overlapping Astronomical Sources using Spatial and Spectral Information
• Systematic evaluation of variability detection methods for eROSITA
• On the faintest solar coronal hard X-rays observed with FOXSI
• Objective Bayesian analysis of "on/off" measurements
• Statistical Tools for Imaging Atmospheric Cherenkov Telescopes
• Signal estimation in On/Off measurements including event-by-event variables
• The Cherenkov Telescope Array On-Site integral sensitivity: observing the Crab
• Characterising X-ray variability in light curves with complex sampling patterns: application to the eROSITA south ecliptic pole survey
• Characterisation of the X-ray point source variability in the eROSITA south ecliptic pole field
• On the analysis of signal peaks in pulse-height spectra
• On Bayesian analysis of on-off measurements
• On Integral Upper Limits Assuming Power Law Spectra and the Sensitivity in High-Energy Astronomy
• A Bayesian on-off analysis of cosmic ray data
• Optimising an Array of Cherenkov Telescopes in Australia for the Detection of TeV Gamma-Ray Transients