6 papers
Multicalibration for Unbiased Model-Based Prevalence Estimation
Fridolin Linder, Thomas Leeper, Daniel Haimovich +3
Estimating the prevalence of a category in a population using imperfect measurement devices (diagnostic tests, classifiers, or large language models) is fundamental to science, pub…
On the Convergence of Multicalibration Gradient Boosting
Daniel Haimovich, Fridolin Linder, Lorenzo Perini +2
Multicalibration gradient boosting has recently emerged as a scalable method that empirically produces approximately multicalibrated predictors and has been deployed at web scale.…
Multicalibration Yields Better Matchings
Riccardo Colini Baldeschi, Simone Di Gregorio, Simone Fioravanti +9
Consider the problem of finding the best matching in a weighted graph where we only have access to predictions of the actual stochastic weights, based on an underlying context. If…
MCGrad: Multicalibration at Web Scale
Niek Tax, Lorenzo Perini, Fridolin Linder +5
We propose MCGrad, a novel and scalable multicalibration algorithm. Multicalibration - calibration in subgroups of the data - is an important property for the performance of machin…
Measuring multi-calibration
Ido Guy, Daniel Haimovich, Fridolin Linder +4
A suitable scalar metric can help measure multi-calibration, defined as follows. When the expected values of observed responses are equal to corresponding predicted probabilities,…
On the Convergence of Loss and Uncertainty-based Active Learning Algorithms
Daniel Haimovich, Dima Karamshuk, Fridolin Linder +2
We investigate the convergence rates and data sample sizes required for training a machine learning model using a stochastic gradient descent (SGD) algorithm, where data points are…