6 papers
Embeddings for Preferences, Not Semantics
Carter Blair, Ariel D. Procaccia, Milind Tambe
Modern AI is opening the door to collective decision-making in which participants express their views as free-form text rather than voting on a fixed set of candidates. A natural i…
Probably Approximately Consensus: On the Learning Theory of Finding Common Ground
Carter Blair, Ben Armstrong, Shiri Alouf-Heffetz +2
A primary goal of online deliberation platforms is to identify ideas that are broadly agreeable to a community of users through their expressed preferences. Yet, consensus elicitat…
Procedural Fairness in Multi-Agent Bandits
Joshua Caiata, Carter Blair, Kate Larson
In the context of multi-agent multi-armed bandits (MA-MAB), fairness is often reduced to outcomes: maximizing welfare, reducing inequality, or balancing utilities. However, evidenc…
Generating Fair Consensus Statements with Social Choice on Token-Level MDPs
Carter Blair, Kate Larson
Current frameworks for consensus statement generation with large language models lack the inherent structure needed to provide provable fairness guarantees when aggregating diverse…
Reflective Verbal Reward Design for Pluralistic Alignment
Carter Blair, Kate Larson, Edith Law
AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback…
Democratizing Reward Design for Personal and Representative Value-Alignment
Carter Blair, Kate Larson, Edith Law
Aligning AI agents with human values is challenging due to diverse and subjective notions of values. Standard alignment methods often aggregate crowd feedback, which can result in…