Statistical biases in measurements with multiple candidates

Abstract

Many measurements at collider experiments study physics candidates that are a subset of a collision event. The presence of multiple such candidates in a given event can cause raw biases which are large compared to typical statistical uncertainties. Selecting a single candidate is common practice but only helps if the likelihood of selecting the true candidate is very high. Otherwise the precision of the measurement can be affected, and biases can be generated, even if none are present in the data sample prior to this operation. This paper aims at describing the problem in a systematic way. It sets definitions, provides examples of potential biases using pseudoexperiments and gives recommendations.

This is the 2019 update of the original 2017 preprint

References in corpus (42)

• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• Combined Measurement of the Higgs Boson Mass in $pp$ Collisions at $\sqrt{s}=7$ and 8 TeV with the ATLAS and CMS Experiments
• Description and performance of track and primary-vertex reconstruction with the CMS tracker
• Test of lepton universality with $B^0\to K^{\ast 0}{\ell }^{+}{\ell }^{-}$ decays
• Observation of the doubly charmed baryon ${\Xi }_{cc}^{++}$
• Observation of the diphoton decay of the Higgs boson and measurement of its properties
• Search for direct production of charginos, neutralinos and sleptons in final states with two leptons and missing transverse momentum in pp collisions at sqrt(s) = 8 TeV with the ATLAS detector
• Measurement of the Higgs boson mass from the $H\to \gamma \gamma$ and $H\to Z{Z}^{\ast }\to 4\ell$ channels with the ATLAS detector using 25 fb${}^{-1}$ of $pp$ collision data
• Measurement of the $B_s^0\to {\mu }^{+}{\mu }^{-}$ branching fraction and effective lifetime and search for $B^0\to {\mu }^{+}{\mu }^{-}$ decays
• Branching Ratio Measurements of $B_s$ Decays
• J/psi Production vs Transverse Momentum and Rapidity in p+p Collisions at sqrt(s) = 200 GeV
• Angular analysis of $B_d^0\to K^{\ast }{\mu }^{+}{\mu }^{-}$ decays in $pp$ collisions at $\sqrt{s}=8$ TeV with the ATLAS detector
• Amplitude analysis of $B^{-}\to D^{+}{\pi }^{-}{\pi }^{-}$ decays
• Measurement of prompt J/psi pair production in pp collisions at sqrt(s) = 7 TeV
• Measurement of the $b$-quark production cross-section in 7 and 13 TeV $pp$ collisions
• Searches for heavy long-lived charged particles with the ATLAS detector in proton-proton collisions at $\sqrt{s}$ = 8 TeV
• Search for structure in the $B_s^0{\pi }^{\pm }$ invariant mass spectrum
• Search for the direct production of charginos, neutralinos and staus in final states with at least two hadronically decaying taus and missing transverse momentum in $pp$ collisions at $\sqrt{s}$ = 8 TeV with the ATLAS detector
• Study of the $D^{0}p$ amplitude in ${\Lambda }_b^0\to D^{0}p{\pi }^{-}$ decays
• Measurement of the $J/\psi$ pair production cross-section in $pp$ collisions at $\sqrt{s}=13\mathrm{TeV}$
• Observation of two new ${\Xi }_b^{-}$ baryon resonances
• Study of the kinematic dependences of ${\Lambda }_b^0$ production in $pp$ collisions and a measurement of the ${\Lambda }_b^0\to {\Lambda }_c^{+}{\pi }^{-}$ branching fraction
• Study of B{+-,0} --> J/ψ K+ K- K{+-,0} and search for B0 --> J/ψ ϕ at BABAR
• sFit: a method for background subtraction in maximum likelihood fit
• Search for a Structure in the $B_s^0{\pi }^{\pm }$ Invariant Mass Spectrum with the ATLAS Experiment
• Measurement of $CP$ asymmetries in two-body $B_{(s)}^0$-meson decays to charged pions and kaons
• Measurement of $CP$ observables in $B^{\pm }\to D^{(\ast )}{K}^{\pm }$ and $B^{\pm }\to D^{(\ast )}{\pi }^{\pm }$ decays
• A measurement of the $CP$ asymmetry difference in ${\Lambda }_c^{+}\to p{K}^{-}{K}^{+}$ and $p{\pi }^{-}{\pi }^{+}$ decays
• Search for muoproduction of $X(3872)$ at COMPASS and indication of a new state $\tilde{X}(3872)$
• Search for CP violation using triple product asymmetries in ${\Lambda }_b^0\to p{K}^{-}{\pi }^{+}{\pi }^{-}$, ${\Lambda }_b^0\to p{K}^{-}{K}^{+}{K}^{-}$ and ${\Xi }_b^0\to p{K}^{-}{K}^{-}{\pi }^{+}$ decays
• Measurement of angular and CP asymmetries in $D^0\to {\pi }^{+}{\pi }^{-}{\mu }^{+}{\mu }^{-}$ and $D^0\to K^{+}{K}^{-}{\mu }^{+}{\mu }^{-}$ decays
• Search for $CP$ violation in ${\Lambda }_b^0\to p{K}^{-}$ and ${\Lambda }_b^0\to p{\pi }^{-}$ decays
• Measurement of the $B_s^0\to J/\psi K_S^0$ branching fraction
• First measurement of the $CP$-violating phase ${\varphi }_s^{d\overline{d}}$ in $B_s^0\to (K^{+}{\pi }^{-})(K^{-}{\pi }^{+})$ decays
• Measurement of $y_{CP}$ in $D^0-{\overline{D}}^0$ oscillation using quantum correlations in $e^{+}{e}^{-}\to D^0{\overline{D}}^0$ at $\sqrt{s}$ = 3.773\,GeV
• Search for squarks and gluinos in events with hadronically decaying tau leptons, jets and missing transverse momentum in proton-proton collisions at $\sqrt{s}=13$ TeV recorded with the ATLAS detector
• Observation of the decay $B_s^0\to {\overline{D}}^0{K}^{+}{K}^{-}$
• Observation of $B_s^0\to {\overline{D}}^{\ast 0}\varphi$ and search for $B^0\to {\overline{D}}^0\varphi$ decays
• Measurement of the $B_s^0\to J/\psi \eta$ lifetime
• Search for a light Higgs resonance in radiative decays of the Y(1S) with a charm tag
• Measurement of the branching fraction and $CP$ asymmetry in $B^{+}\to J/\psi {\rho }^{+}$ decays

Cited by in corpus (2)

• Observation of the decay $B_s^0\to {\overline{D}}^0{K}^{+}{K}^{-}$
• Observation of $B_s^0\to {\overline{D}}^{\ast 0}\varphi$ and search for $B^0\to {\overline{D}}^0\varphi$ decays