Plotting the Differences Between Data and Expectation

Abstract

This article proposes a way to improve the presentation of histograms where data are compared to expectation. Sometimes, it is difficult to judge by eye whether the difference between the bin content and the theoretical expectation (provided by either a fitting function or another histogram) is just due to statistical fluctuations. More importantly, there could be statistically significant deviations which are completely invisible in the plot. We propose to add a small inset at the bottom of the plot, in which the statistical significance of the deviation observed in each bin is shown. Even though the numerical routines which we developed have only illustration purposes, it comes out that they are based on formulae which could be used to perform statistical inference in a proper way. An implementation of our computation is available at https://github.com/dcasadei/psde .

10 pages, 7 figures. CODE: https://github.com/dcasadei/psde

References in corpus (4)

• ROOT - A C++ Framework for Petabyte Data Storage, Statistical Analysis and Visualization
• Evaluation of three methods for calculating statistical significance when incorporating a systematic uncertainty into a test of the background-only hypothesis for a Poisson process
• Search for New Physics in the Dijet Mass Distribution using 1 fb^-1 of pp Collision Data at sqrt(s) = 7 TeV collected by the ATLAS Detector
• Statistical methods used in ATLAS for exclusion and discovery

Cited by in corpus (33)

• Search for new phenomena in the dijet mass distribution using $p-p$ collision data at $\sqrt{s}=8$ TeV with the ATLAS detector
• Search for additional heavy neutral Higgs and gauge bosons in the ditau final state produced in 36 fb${}^{-1}$ of $pp$ collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector
• Search for high-mass diboson resonances with boson-tagged jets in proton-proton collisions at $\sqrt{s}$ = 8 TeV with the ATLAS detector
• Search for high-mass diphoton resonances in $pp$ collisions at $\sqrt{s}=8$ TeV with the ATLAS detector
• ATLAS search for new phenomena in dijet mass and angular distributions using pp collisions at sqrt(s)=7 TeV
• Search for low-mass dijet resonances using trigger-level jets with the ATLAS detector in $pp$ collisions at $\sqrt{s}=13$ TeV
• Search for a scalar partner of the top quark in the all-hadronic $t\bar{t}$ plus missing transverse momentum final state at $\sqrt{s}=13$ TeV with the ATLAS detector
• Search for pair production of a new heavy quark that decays into a $W$ boson and a light quark in $pp$ collisions at $\sqrt{s}=8$ TeV with the ATLAS detector
• Search for Extra Dimensions in diphoton events using proton-proton collisions recorded at sqrt(s) = 7 TeV with the ATLAS detector at the LHC
• Search for diboson resonances with boson-tagged jets in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Search for new phenomena in photon+jet events collected in proton--proton collisions at sqrt(s) = 8 TeV with the ATLAS detector
• Search for bottom-squark pair production with the ATLAS detector in final states containing Higgs bosons, $b$-jets and missing transverse momentum
• Search for diboson resonances in hadronic final states in 139 fb${}^{-1}$ of $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Search for dark matter in association with an energetic photon in pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector
• Search for pair production of higgsinos in final states with at least three $b$-tagged jets in $\sqrt{s}=13$ TeV $pp$ collisions using the ATLAS detector
• Fully Bayesian Unfolding
• Search for dark matter produced in association with a single top quark in $\sqrt{s}=13$ TeV $pp$ collisions with the ATLAS detector
• Search for heavy resonances decaying to a photon and a hadronically decaying $Z/W/H$ boson in $pp$ collisions at $\sqrt{s}=13$ $\mathrm{TeV}$ with the ATLAS detector
• Search for dijet resonances in events with an isolated charged lepton using $\sqrt{s}=13$ TeV proton-proton collision data collected by the ATLAS detector
• Search for Higgs boson production in association with a high-energy photon via vector-boson fusion with decay into bottom quark pairs at $\sqrt{s}$=13 TeV with the ATLAS detector
• Search for pairs of highly collimated photon-jets in $pp$ collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector
• Search for production of resonant states in the photon-jet mass distribution using pp collisions at sqrt(s) = 7 TeV collected by the ATLAS detector
• Search for low-scale gravity signatures in multi-jet final states with the ATLAS detector at $\sqrt{s}=8$ TeV
• Objective Bayesian analysis of "on/off" measurements
• Search for heavy resonances decaying into a photon and a hadronically decaying Higgs boson in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Search for new phenomena in multi-body invariant masses in events with at least one isolated lepton and two jets using $\sqrt{s}=13$ TeV proton-proton collision data collected by the ATLAS detector
• Search for heavy particles in the $b$-tagged dijet mass distribution with additional $b$-tagged jets in proton-proton collisions at $\sqrt{s}=13$ TeV with the ATLAS experiment
• Search for high-mass resonances in final states with a $\tau$-lepton and missing transverse momentum with the ATLAS detector
• Search for new phenomena in final states with photons, jets and missing transverse momentum in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Search for high-mass $W\gamma$ and $Z\gamma$ resonances using hadronic W/Z boson decays from 139 fb${}^{-1}$ of $pp$ collisions at $\sqrt{s}=$ 13 TeV with the ATLAS detector
• Advances in Multi-Variate Analysis Methods for New Physics Searches at the Large Hadron Collider
• Detection limit of a lutetium based non-paralizable PET detector
• Search for signatures of electroweakinos with photons, jets, and large missing transverse momentum in $\sqrt{s}=13$ TeV pp collisions with the ATLAS detector