51 citations · 64 across the 9 of their papers we have counts for
11 papers
When Goals Leak Across Relationships: How Cached Goal Representations Shape Cross-Client Decisions
Saloni Gupta, Sébastien Krier, Glenn Matlin
As LLM agents take on more autonomous roles, they may interact with multiple clients and counterparties whose goals and incentives conflict. If an agent maintains shared inference…
Agentic Economies for Autonomous Scientific Discovery
Nenad Tomasev, Matija Franklin, Atoosa Kasirzadeh +4
Recent advances in agentic Artificial Intelligence (AI) systems have marked a shift in AI for Science: moving away from the use of individual AI systems for narrow task execution,…
Role Steering of Language Models for Social Simulations
Isaac Song, Mohammed Rehan Parwani, Glenn Matlin +8
Social simulations built from language-model agents need role-conditioned behavior that can be checked before agents are placed into a simulated population. We introduce an activat…
Positive Alignment: Artificial Intelligence for Human Flourishing
Ruben Laukkonen, Seb Krier, Chloé Bakalar +13
Existing alignment research is dominated by concerns about safety and preventing harm: safeguards, controllability, and compliance. This paradigm of alignment parallels early psych…
Comprehensive AI governance requires addressing non-model gains
Arthur Goemans, Dan Altman, Noemi Dreksler +8
Frontier AI governance often centres on the model-level governance paradigm, which assumes that a model's capability profile is primarily a function of the compute and data used du…
Distributional AGI Safety
Nenad Tomašev, Matija Franklin, Julian Jacobs +2
AI safety and alignment research has predominantly been focused on methods for safeguarding individual AI systems, resting on the assumption of an eventual emergence of a monolithi…
Societal and technological progress as sewing an ever-growing, ever-changing, patchy, and polychrome quilt
Joel Z. Leibo, Alexander Sasha Vezhnevets, William A. Cunningham +3
Artificial Intelligence (AI) systems are increasingly placed in positions where their decisions have real consequences, e.g., moderating online spaces, conducting research, and adv…
An Approach to Technical AGI Safety and Security
Rohin Shah, Alex Irpan, Alexander Matt Turner +27
Artificial General Intelligence (AGI) promises transformative benefits but also presents significant risks. We develop an approach to address the risk of harms consequential enough…
AGI, Governments, and Free Societies
Justin B. Bullock, Samuel Hammond, Seb Krier
This paper examines how artificial general intelligence (AGI) could fundamentally reshape the delicate balance between state capacity and individual liberty that sustains free soci…
Multi-Agent Risks from Advanced AI
Lewis Hammond, Alan Chan, Jesse Clifton +41
The rapid development of advanced AI agents and the imminent deployment of many instances of these agents will give rise to multi-agent systems of unprecedented complexity. These s…
The Ethics of Advanced AI Assistants
Iason Gabriel, Arianna Manzini, Geoff Keeling +54
This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural langu…