8 papers
The Sample Complexity of Multicalibration
Natalie Collina, Jiuyao Lu, Georgy Noarov +1
We study the minimax sample complexity of multicalibration in the batch setting. A learner observes i.i.d. samples from an unknown distribution and must output a (possibly rand…
Personalization Aids Pluralistic Alignment Under Competition
Natalie Collina, Surbhi Goel, Aaron Roth +1
Can competition among misaligned AI providers yield aligned outcomes for a diverse population of users, and what role does model personalization play? We study a setting where mult…
Emergent Alignment via Competition
Natalie Collina, Surbhi Goel, Aaron Roth +2
Aligning AI systems with human values remains a fundamental challenge, but does our inability to create perfectly aligned models preclude obtaining the benefits of alignment? We st…
The ICML 2023 Ranking Experiment: Examining Author Self-Assessment in ML/AI Peer Review
Buxin Su, Jiayao Zhang, Natalie Collina +6
We conducted an experiment during the review process of the 2023 International Conference on Machine Learning (ICML), asking authors with multiple submissions to rank their papers…
Conformal Language Model Reasoning with Coherent Factuality
Maxon Rubin-Toles, Maya Gambhir, Keshav Ramji +2
Language models are increasingly being used in important decision pipelines, so ensuring the correctness of their outputs is crucial. Recent work has proposed evaluating the "factu…
Collaborative Prediction: Tractable Information Aggregation via Agreement
Natalie Collina, Ira Globus-Harris, Surbhi Goel +3
We give efficient "collaboration protocols" through which two parties, who observe different features about the same instances, can interact to arrive at predictions that are more…