72 citations · 147 across the 96 of their papers we have counts for
4 papers · 1 filter
Distribution-free calibration guarantees for histogram binning without sample splitting
Chirag Gupta, Aaditya K. Ramdas
We prove calibration guarantees for the popular histogram binning (also called uniform-mass binning) method of Zadrozny and Elkan [2001]. Histogram binning has displayed strong pra…
Distribution-free uncertainty quantification for classification under label shift
Aleksandr Podkopaev, Aaditya Ramdas
Trustworthy deployment of ML models requires a proper measure of uncertainty, especially in safety-critical applications. We focus on uncertainty quantification (UQ) for classifica…
Off-policy Confidence Sequences
Nikos Karampatziakis, Paul Mineiro, Aaditya Ramdas
We develop confidence bounds that hold uniformly over time for off-policy evaluation in the contextual bandit setting. These confidence sequences are based on recent ideas from mar…
Testing exchangeability: fork-convexity, supermartingales, and e-processes
Aaditya Ramdas, Johannes Ruf, Martin Larsson +1
Suppose we observe an infinite series of coin flips , and wish to sequentially test the null that these binary random variables are exchangeable. Nonnegative superm…