495 citations · 597 across the 7 of their papers we have counts for
7 papers
Towards best practices in AGI safety and governance: A survey of expert opinion
Jonas Schuett, Noemi Dreksler, Markus Anderljung +4
A number of leading AI companies, including OpenAI, Google DeepMind, and Anthropic, have the stated goal of building artificial general intelligence (AGI) - AI systems that achieve…
Model evaluation for extreme risks
Toby Shevlane, Sebastian Farquhar, Ben Garfinkel +18
Current approaches to building general-purpose AI systems tend to produce systems with both beneficial and harmful capabilities. Further progress in AI development could lead to ca…
Exploring the Relevance of Data Privacy-Enhancing Technologies for AI Governance Use Cases
Emma Bluemke, Tantum Collins, Ben Garfinkel +1
The development of privacy-enhancing technologies has made immense progress in reducing trade-offs between privacy and performance in data exchange and analysis. Similar tools for…
Democratising AI: Multiple Meanings, Goals, and Methods
Elizabeth Seger, Aviv Ovadya, Ben Garfinkel +2
Numerous parties are calling for the democratisation of AI, but the phrase is used to refer to a variety of goals, the pursuit of which sometimes conflict. This paper identifies fo…
The Windfall Clause: Distributing the Benefits of AI for the Common Good
Cullen O'Keefe, Peter Cihon, Ben Garfinkel +3
As the transformative potential of AI has become increasingly salient as a matter of public and political interest, there has been growing discussion about the need to ensure that…
The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Miles Brundage, Shahar Avin, Jack Clark +23
This report surveys the landscape of potential security threats from malicious uses of AI, and proposes ways to better forecast, prevent, and mitigate these threats. After analyzin…
On the Impossibility of Supersized Machines
Ben Garfinkel, Miles Brundage, Daniel Filan +6
In recent years, a number of prominent computer scientists, along with academics in fields such as philosophy and physics, have lent credence to the notion that machines may one da…