495 citations · 951 across the 11 of their papers we have counts for
5 papers · 1 filter
AI Systems of Concern
Kayla Matteucci, Shahar Avin, Fazl Barez +1
Concerns around future dangers from advanced AI often centre on systems hypothesised to have intrinsic characteristics such as agent-like behaviour, strategic awareness, and long-r…
Model evaluation for extreme risks
Toby Shevlane, Sebastian Farquhar, Ben Garfinkel +18
Current approaches to building general-purpose AI systems tend to produce systems with both beneficial and harmful capabilities. Further progress in AI development could lead to ca…
Filling gaps in trustworthy development of AI
Shahar Avin, Haydn Belfield, Miles Brundage +9
The range of application of artificial intelligence (AI) is vast, as is the potential for harm. Growing awareness of potential risks from AI systems has spurred action to address t…
Between Progress and Potential Impact of AI: the Neglected Dimensions
Fernando Martínez-Plumed, Shahar Avin, Miles Brundage +3
We reframe the analysis of progress in AI by incorporating into an overall framework both the task performance of a system, and the time and resource costs incurred in the developm…
The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Miles Brundage, Shahar Avin, Jack Clark +23
This report surveys the landscape of potential security threats from malicious uses of AI, and proposes ways to better forecast, prevent, and mitigate these threats. After analyzin…