6 papers
The Case for Globally Beneficial Technology
Iason Gabriel, Atoosa Kasirzadeh
To whom do the fruits of advanced technological innovation belong? To their inventors, to the organizations and individuals involved in making such discoveries possible, or to stil…
Legal Alignment for Safe and Ethical AI
Noam Kolt, Nicholas Caputo, Jack Boeglin +14
Alignment of artificial intelligence (AI) encompasses the normative problem of specifying how AI systems should act and the technical problem of ensuring AI systems comply with tho…
Agentic Inequality
Matthew Sharp, Omer Bilgin, Iason Gabriel +1
Autonomous AI agents capable of complex planning and action mark a shift beyond today's generative tools. As these systems enter political and economic life, who can access them, h…
Resource Rational Contractualism Should Guide AI Alignment
Sydney Levine, Matija Franklin, Tan Zhi-Xuan +8
AI systems will soon have to navigate human environments and make decisions that affect people and other AI agents whose goals and values diverge. Contractualist alignment proposes…
Full-Stack Alignment: Co-Aligning AI and Institutions with Thick Models of Value
Joe Edelman, Tan Zhi-Xuan, Ryan Lowe +30
Beneficial societal outcomes cannot be guaranteed by aligning individual AI systems with the intentions of their operators or users. Even an AI system that is perfectly aligned to…
Characterizing AI Agents for Alignment and Governance
Atoosa Kasirzadeh, Iason Gabriel
The creation of effective governance mechanisms for AI agents requires a deeper understanding of their core properties and how these properties relate to questions surrounding the…