5 papers
Aligned Textual Scoring Rules
Yuxuan Lu, Yifan Wu, Jason Hartline +1
Scoring rules elicit probabilistic predictions from a strategic agent by scoring the prediction against a ground truth state. A scoring rule is proper if, from the agent's perspect…
Smooth Calibration and Decision Making
Jason Hartline, Yifan Wu, Yunran Yang
Calibration requires predictor outputs to be consistent with their Bayesian posteriors. For machine learning predictors that do not distinguish between small perturbations, calibra…
Conformal Prediction and Human Decision Making
Jessica Hullman, Yifan Wu, Dawei Xie +2
Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular m…
Explaining and Improving Information Complementarities in Multi-Agent Decision-making
Ziyang Guo, Yifan Wu, Jason Hartline +1
Multiple agents are increasingly combined to make decisions with the expectation of achieving complementary performance, where the decisions they make together outperform those mad…
Unexploited Information Value in Human-AI Collaboration
Ziyang Guo, Yifan Wu, Jason Hartline +1
Humans and AIs are often paired on decision tasks with the expectation of achieving complementary performance -- where the combination of human and AI outperforms either one alone.…