6 citations · 17 across the 9 of their papers we have counts for
9 papers
Prioritization of Risks from Artificial Intelligence: A Delphi Study of 272 International Experts
Alexander K. Saeri, Jess Graham, Michael Noetel +185
Artificial intelligence poses many risks, ranging from familiar present-day harms to unprecedented and potentially catastrophic ones. Effective risk management requires prioritizat…
The Case for ESM3 as a General-Purpose AI Model with Systemic Risk Under the EU AI Act
Taro Qureshi, Jacob Griffith, Koen Holtman +3
Due to ambiguity in the wording of the EU AI Act, we examine the question of to what extent frontier biological foundation models such as ESM3 are subject to obligations for genera…
Open Problems in Frontier AI Risk Management
Marta Ziosi, Miro Plueckebaum, Stephen Casper +26
Frontier AI both amplifies existing risks and introduces qualitatively novel challenges. Not only is there a notable lack of stable scientific consensus resulting from the rapid pa…
Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems
Rokas Gipiškis, Ayrton San Joaquin, Ze Shen Chin +3
There is an urgent need to identify both short and long-term risks from newly emerging types of Artificial Intelligence (AI), as well as available risk management measures. In resp…
Demanding and Designing Aligned Cognitive Architectures
Koen Holtman
With AI systems becoming more powerful and pervasive, there is increasing debate about keeping their actions aligned with the broader goals and needs of humanity. This multi-discip…
Counterfactual Planning in AGI Systems
Koen Holtman
We present counterfactual planning as a design approach for creating a range of safety mechanisms that can be applied in hypothetical future AI systems which have Artificial Genera…
AGI Agent Safety by Iteratively Improving the Utility Function
Koen Holtman
While it is still unclear if agents with Artificial General Intelligence (AGI) could ever be built, we can already use mathematical models to investigate potential safety systems f…
Corrigibility with Utility Preservation
Koen Holtman
Corrigibility is a safety property for artificially intelligent agents. A corrigible agent will not resist attempts by authorized parties to alter the goals and constraints that we…
Appcessory Economics: Enabling loosely coupled hardware / software innovation
Koen Holtman
An appcessory (app + accessory) is a smart phone accessory that is combined with a specially written app to perform a useful function. An example is a toy helicopter controlled by…