120 citations · 372 across the 25 of their papers we have counts for
30 papers
The Impossibility of Eliciting Latent Knowledge
Korbinian Friedl, Francis Rhys Ward, Paul Yushin Rapoport +2
Advanced AI systems have extensive knowledge of their environments; in fact, their knowledge may (far) exceed that of their developers or users. Consequently, a desirable property…
An Approach to Technical AGI Safety and Security
Rohin Shah, Alex Irpan, Alexander Matt Turner +27
Artificial General Intelligence (AGI) promises transformative benefits but also presents significant risks. We develop an approach to address the risk of harms consequential enough…
Honesty Is the Best Policy: Defining and Mitigating AI Deception
Francis Rhys Ward, Francesco Belardinelli, Francesca Toni +1
Deceptive agents are a challenge for the safety, trustworthiness, and cooperation of AI systems. We focus on the problem that agents might deceive in order to achieve their goals (…
Characterising Decision Theories with Mechanised Causal Graphs
Matt MacDermott, Tom Everitt, Francesco Belardinelli
How should my own decisions affect my beliefs about the outcomes I expect to achieve? If taking a certain action makes me view myself as a certain type of person, it might affect h…
Reasoning about Causality in Games
Lewis Hammond, James Fox, Tom Everitt +3
Causal reasoning and game-theoretic reasoning are fundamental topics in artificial intelligence, among many other disciplines: this paper is concerned with their intersection. Desp…
Discovering Agents
Zachary Kenton, Ramana Kumar, Sebastian Farquhar +3
Causal models of agents have been used to analyse the safety aspects of machine learning systems. But identifying agents is non-trivial -- often the causal model is just assumed by…