10 papers
Open Problems in AI Incident Governance
Harleen Kaur Sidhu, Rebecca Scholefield, Nour Annan +5
AI systems may produce failures after deployment that pre-deployment safety assessments do not anticipate. Managing these failures requires what we refer to as adequate \textit{AI…
Prioritization of Risks from Artificial Intelligence: A Delphi Study of 272 International Experts
Alexander K. Saeri, Jess Graham, Michael Noetel +185
Artificial intelligence poses many risks, ranging from familiar present-day harms to unprecedented and potentially catastrophic ones. Effective risk management requires prioritizat…
Reframing AI Loss of Control: What Control Is, How to Have It, How to Lose It
Ze Shen Chin, Maurice Chiodo, Dennis Müller +1
At present, loss of control risks have gained much prominence in public discussion, particularly in relation to AI, with extensive discourse present among academics, frontier labs,…
Principles and Guidelines for Randomized Controlled Trials in AI Evaluation
Christopher Kelly, Angelica Chowdhury, Alexandra Campili +5
This work establishes a framework for standardizing AI evaluation RCTs (sometimes called human uplift studies). Drawing on established practices from disciplines with established R…
The Case for ESM3 as a General-Purpose AI Model with Systemic Risk Under the EU AI Act
Taro Qureshi, Jacob Griffith, Koen Holtman +3
Due to ambiguity in the wording of the EU AI Act, we examine the question of to what extent frontier biological foundation models such as ESM3 are subject to obligations for genera…
Open Problems in Frontier AI Risk Management
Marta Ziosi, Miro Plueckebaum, Stephen Casper +26
Frontier AI both amplifies existing risks and introduces qualitatively novel challenges. Not only is there a notable lack of stable scientific consensus resulting from the rapid pa…