51 citations · 64 across the 9 of their papers we have counts for
5 papers · 1 filter
When Goals Leak Across Relationships: How Cached Goal Representations Shape Cross-Client Decisions
Saloni Gupta, Sébastien Krier, Glenn Matlin
As LLM agents take on more autonomous roles, they may interact with multiple clients and counterparties whose goals and incentives conflict. If an agent maintains shared inference…
Positive Alignment: Artificial Intelligence for Human Flourishing
Ruben Laukkonen, Seb Krier, Chloé Bakalar +13
Existing alignment research is dominated by concerns about safety and preventing harm: safeguards, controllability, and compliance. This paradigm of alignment parallels early psych…
Distributional AGI Safety
Nenad Tomašev, Matija Franklin, Julian Jacobs +2
AI safety and alignment research has predominantly been focused on methods for safeguarding individual AI systems, resting on the assumption of an eventual emergence of a monolithi…
Societal and technological progress as sewing an ever-growing, ever-changing, patchy, and polychrome quilt
Joel Z. Leibo, Alexander Sasha Vezhnevets, William A. Cunningham +3
Artificial Intelligence (AI) systems are increasingly placed in positions where their decisions have real consequences, e.g., moderating online spaces, conducting research, and adv…
An Approach to Technical AGI Safety and Security
Rohin Shah, Alex Irpan, Alexander Matt Turner +27
Artificial General Intelligence (AGI) promises transformative benefits but also presents significant risks. We develop an approach to address the risk of harms consequential enough…