Performance of Test Supermartingale Confidence Intervals for the Success Probability of Bernoulli Trials
arXiv:1709.04078 · doi:10.6028/jres.125.003
Abstract
Given a composite null hypothesis H, test supermartingales are non-negative supermartingales with respect to H with initial value 1. Large values of test supermartingales provide evidence against H. As a result, test supermartingales are an effective tool for rejecting H, particularly when the p-values obtained are very small and serve as certificates against the null hypothesis. Examples include the rejection of local realism as an explanation of Bell test experiments in the foundations of physics and the certification of entanglement in quantum information science. Test supermartingales have the advantage of being adaptable during an experiment and allowing for arbitrary stopping rules. By inversion of acceptance regions, they can also be used to determine confidence sets. We use an example to compare the performance of test supermartingales for computing p-values and confidence intervals to Chernoff-Hoeffding bounds and the "exact" p-value. The example is the problem of inferring the probability of success in a sequence of Bernoulli trials. There is a cost in using a technique that has no restriction on stopping rules, and for a particular test supermartingale, our study quantifies this cost.
References in corpus (12)
- Experimental loophole-free violation of a Bell inequality using entangled electron spins separated by 1.3 km
- Significant-loophole-free test of Bell's theorem with entangled photons
- A strong loophole-free test of local realism
- Research on Hidden Variable Theories: a review of recent progresses
- Event-Ready Bell Test Using Entangled Atoms Simultaneously Closing Detection and Locality Loopholes
- Certified randomness in quantum physics
- Loopholes in Bell Inequality Tests of Local Realism
- Asymptotically optimal data analysis for rejecting local realism
- Test Martingales, Bayes Factors and -Values
- A Robust Mathematical Model for Clauser-Horne Experiments, With Implications for Rigorous Statistical Analysis
- Efficient quantification of experimental evidence against local realism
- Analysis of Coincidence-Time Loopholes in Experimental Bell Tests