10 citations · 21 across the 7 of their papers we have counts for
8 papers
Reading the Room: Foundations, Design, and Challenges of Normative Competence in LLMs
Andrea Wynn, Harsh Satija, Nathan Baek +5
Human communities are governed by normative systems: shared standards that produce \textit{norms} dictating acceptable behavior, enforced through community sanctioning. Aligning in…
Legal Alignment for Safe and Ethical AI
Noam Kolt, Nicholas Caputo, Jack Boeglin +14
Alignment of artificial intelligence (AI) encompasses the normative problem of specifying how AI systems should act and the technical problem of ensuring AI systems comply with tho…
Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
Andrea Wynn, Harsh Satija, Gillian Hadfield
While multi-agent debate has been proposed as a promising strategy for improving AI reasoning ability, we find that debate can sometimes be harmful rather than helpful. Prior work…
Multi-Agent Risks from Advanced AI
Lewis Hammond, Alan Chan, Jesse Clifton +41
The rapid development of advanced AI agents and the imminent deployment of many instances of these agents will give rise to multi-agent systems of unprecedented complexity. These s…
Infrastructure for AI Agents
Alan Chan, Kevin Wei, Sihao Huang +5
AI agents plan and execute interactions in open-ended environments. For example, OpenAI's Operator can use a web browser to do product comparisons and buy online goods. Much resear…
AI Model Registries: A Foundational Tool for AI Governance
Elliot McKernon, Gwyn Glasser, Deric Cheng +1
In this report, we propose the implementation of national registries for frontier AI models as a foundational tool for AI governance. We explore the rationale, design, and implemen…
How will advanced AI systems impact democracy?
Christopher Summerfield, Lisa Argyle, Michiel Bakker +20
Advanced AI systems capable of generating humanlike text and multimodal content are now widely available. In this paper, we discuss the impacts that generative artificial intellige…
Normative Modules: A Generative Agent Architecture for Learning Norms that Supports Multi-Agent Cooperation
Atrisha Sarkar, Andrei Ioan Muresanu, Carter Blair +3
Generative agents, which implement behaviors using a large language model (LLM) to interpret and evaluate an environment, has demonstrated the capacity to solve complex tasks acros…