3 papers
cs.AI2026
Unbiased Prevalence Estimation with Multicalibrated LLMs
Fridolin Linder, Thomas Leeper, Daniel Haimovich +3
Estimating the prevalence of a category in a population using imperfect measurement devices (diagnostic tests, classifiers, or large language models) is fundamental to science, pub…
cs.LG2025
MCGrad: Multicalibration at Web Scale
Niek Tax, Lorenzo Perini, Fridolin Linder +5
We propose MCGrad, a novel and scalable multicalibration algorithm. Multicalibration - calibration in subgroups of the data - is an important property for the performance of machin…
stat.ME2025
Measuring multi-calibration
Ido Guy, Daniel Haimovich, Fridolin Linder +4
A suitable scalar metric can help measure multi-calibration, defined as follows. When the expected values of observed responses are equal to corresponding predicted probabilities,…