4 papers · 1 filter
Sample-Adaptivity Tradeoff in On-Demand Sampling
Nika Haghtalab, Omar Montasser, Mingda Qiao
We study the tradeoff between sample complexity and round complexity in on-demand sampling, where the learning algorithm adaptively samples from distributions over a limited nu…
Truthfulness of Decision-Theoretic Calibration Measures
Mingda Qiao, Eric Zhao
Calibration measures quantify how much a forecaster's predictions violates calibration, which requires that forecasts are unbiased conditioning on the forecasted probabilities. Two…
Truthfulness of Calibration Measures
Nika Haghtalab, Mingda Qiao, Kunhe Yang +1
We initiate the study of the truthfulness of calibration measures in sequential prediction. A calibration measure is said to be truthful if the forecaster (approximately) minimizes…
On the Distance from Calibration in Sequential Prediction
Mingda Qiao, Letian Zheng
We study a sequential binary prediction setting where the forecaster is evaluated in terms of the calibration distance, which is defined as the distance between the predicted…