Testing the statistical compatibility of independent data sets

Abstract

We discuss a goodness-of-fit method which tests the compatibility between statistically independent data sets. The method gives sensible results even in cases where the chi^2-minima of the individual data sets are very low or when several parameters are fitted to a large number of data points. In particular, it avoids the problem that a possible disagreement between data sets becomes diluted by data points which are insensitive to the crucial parameters. A formal derivation of the probability distribution function for the proposed test statistic is given, based on standard theorems of statistics. The application of the method is illustrated on data from neutrino oscillation experiments, and its complementarity to the standard goodness-of-fit is discussed.

17 pages, LaTeX file using RevTEX4, 2 figures and 2 tables included. Minor improvements to the text, one section added. Accepted for publication in Phys.Rev.D

References in corpus (8)

• Search for neutrino oscillations on a long base-line at the CHOOZ nuclear power station
• Getting the most from the statistical analysis of solar neutrino oscillations
• Ruling out four-neutrino oscillation interpretations of the LSND anomaly?
• Constraining neutrino oscillation parameters with current solar and atmospheric data
• Combining first KamLAND results with solar neutrino data
• Frequentist analyses of solar neutrino data (updated including KamLAND and SNO data)
• Status of four-neutrino mass schemes: a global and unified approach to current neutrino oscillation data
• Bayesian View Of Solar Neutrino Oscillations

Cited by in corpus (90)

• The Reactor Antineutrino Anomaly
• The fate of hints: updated global analysis of three-flavor neutrino oscillations
• Phenomenology with Massive Neutrinos
• Status of global fits to neutrino oscillations
• Sterile Neutrino Oscillations: The Global Picture
• Updated global analysis of neutrino oscillations in the presence of eV-scale sterile neutrinos
• NuFit-6.0: Updated global analysis of three-flavor neutrino oscillations
• Measurements of neutrino oscillation in appearance and disappearance channels by the T2K experiment with 6.6E20 protons on target
• Are there sterile neutrinos at the eV scale?
• Physics at a future Neutrino Factory and super-beam facility
• Sterile neutrino oscillations after first MiniBooNE results
• Updated Global 3+1 Analysis of Short-BaseLine Neutrino Oscillations
• Sterile Neutrinos
• A combined analysis of short-baseline neutrino experiments in the (3+1) and (3+2) sterile neutrino oscillation hypotheses
• Global Analyses of Neutrino Oscillation Experiments
• Pragmatic View of Short-Baseline Neutrino Oscillations
• Global neutrino data and recent reactor fluxes: status of three-flavour oscillation parameters
• Limits on nu_e and anti-nu_e disappearance from Gallium and reactor experiments
• Update of Short-Baseline Electron Neutrino and Antineutrino Disappearance
• Status of Light Sterile Neutrino Searches
• 3+1 and 3+2 Sterile Neutrino Fits
• The Absolute Neutrino Mass Scale, Neutrino Mass Spectrum, Majorana CP-Violation and Neutrinoless Double-Beta Decay
• Neutrino Non-Standard Interactions: A Status Report
• Spin-independent elastic WIMP scattering and the DAMA annual modulation signal
• Light sterile neutrinos
• Where Are We With Light Sterile Neutrinos?
• Explaining LSND by a decaying sterile neutrino
• $C_5^A$ axial form factor from bubble chamber experiments
• Implications of 3+1 Short-Baseline Neutrino Oscillations
• Status of 3+1 Neutrino Mixing
• Sterile Neutrinos in Light of Recent Cosmological and Oscillation Data: a Multi-Flavor Scheme Approach
• Short-Baseline Electron Neutrino Disappearance, Tritium Beta Decay and Neutrinoless Double-Beta Decay
• Model-Independent ${\bar{\nu }}_e$ Short-Baseline Oscillations from Reactor Spectral Ratios
• Interpretation of MINOS data in terms of non-standard neutrino interactions
• Reconciling results of LSND, MiniBooNE and other experiments with soft decoherence
• Global fits to neutrino oscillation data
• A possible indication of momentum-dependent asymmetric dark matter in the Sun
• Status of the CPT Violating Interpretations of the LSND Signal
• Decaying Sterile Neutrinos and the Short Baseline Oscillation Anomalies
• Improved measurement of solar neutrinos from the Carbon-Nitrogen-Oxygen cycle by Borexino and its implications for the Standard Solar Model
• Invisible neutrino decay in the light of NOvA and T2K data
• Light Sterile Neutrinos: Status and Perspectives
• Statistical significance of the sterile-neutrino hypothesis in the context of reactor and gallium data
• The LSND and MiniBooNE Oscillation Searches at High $\Delta m^2$
• Light Dark Matter in the light of CRESST-II
• Quantifying (dis)agreement between direct detection experiments in a halo-independent way
• Sterile Neutrinos and the Global Reactor Antineutrino Dataset
• Testing CCQE and 2p2h models in the NEUT neutrino interaction generator with published datasets from the MiniBooNE and MINERvA experiments
• Explaining the MiniBooNE Excess Through a Mixed Model of Oscillation and Decay
• Improved eV-scale Sterile-Neutrino Constraints from the Second KATRIN Measurement Campaign
• A Bayesian interpretation of inconsistency measures in cosmology
• Combining Sterile Neutrino Fits to Short Baseline Data with IceCube Data
• A New Light Higgs Boson and Short-Baseline Neutrino Anomalies
• Light Sterile Neutrinos and Short Baseline Neutrino Oscillation Anomalies
• Viability of $\Delta m^2\sim$ 1 eV${}^2$ sterile neutrino mixing models in light of MiniBooNE electron neutrino and antineutrino data from the Booster and NuMI beamlines
• Neutrino Physics Opportunities with the IsoDAR Source at Yemilab
• Hint of CPT Violation in Short-Baseline Electron Neutrino Disappearance
• Neutrino Phenomenology in a 3+1+1 Framework
• The Simons Observatory: pipeline comparison and validation for large-scale B-modes
• LSND versus MiniBooNE: Sterile neutrinos with energy dependent masses and mixing?
• Gallium Anomaly: Critical View from the Global Picture of ${\nu }_e$ and ${\bar{\nu }}_e$ Disappearance
• VSBL Electron Neutrino Disappearance
• Joint short- and long-baseline constraints on light sterile neutrinos
• The Gran Sasso muon puzzle
• Particle physics origin of the 5 MeV bump in the reactor antineutrino spectrum?
• Large Short-Baseline antinu_mu Disappearance
• Experimental Parameters for a Cerium 144 Based Intense Electron Antineutrino Generator Experiment at Very Short Baselines
• Cosmological discordances III: more on measure properties, Large-Scale-Structure constraints, the Hubble constant and Planck
• Assessing Compatibility of Direct Detection Data: Halo-Independent Global Likelihood Analyses
• Probing New Physics by Comparing Solar and KamLAND Data
• Resonant Diphoton Phenomenology Simplified
• Assessing the role of nuclear effects in the interpretation of the MiniBooNE low-energy anomaly
• Status of Direct Determination of Solar Neutrino Fluxes after Borexino
• Extended Maximum Likelihood Halo-independent Analysis of Dark Matter Direct Detection Data
• Short-Baseline antinu_mu -> antinu_e Oscillations
• Neutrinos from Stored Muons nuSTORM: Expression of Interest
• First Search for Unstable Sterile Neutrinos with the IceCube Neutrino Observatory
• Compatibility of high-$\Delta {\mathrm{m}}^2$ $\nue$ and $\nuebar$ neutrino oscillation searches
• Light, Unstable Sterile Neutrinos: Phenomenology, a Search in the IceCube Experiment, and a Global Picture
• Wilks's Theorem, Global Fits, and Neutrino Oscillations
• Physics of Massive Neutrinos
• Solar Model Independent Constraints on the Sterile Neutrino Interpretation of the Gallium Anomaly
• Recent Developments in Neutrino/Antineutrino - Nucleus Interactions
• Alleviating the present tension between T2K and NO$\nu$A with nonstandard neutrino interactions
• Sterile neutrinos after the first MiniBooNE results
• EUROnu-WP6 2010 Report
• Closing the Neutrino "BSM Gap": Physics Potential of Atmospheric Through-Going Muons at DUNE
• Neutrino oscillation analysis of 217 live-days of Daya Bay and 500 live-days of RENO
• Fitting theory to data in the presence of background uncertainties
• Effect of Correlations Between Model Parameters and Nuisance Parameters When Model Parameters are Fit to Data