152 citations · 826 across the 22 of their papers we have counts for
4 papers · 1 filter
Open Problems in AI Risk Modeling: Insights from a Workshop on the Technical Foundations of AI Risk Modeling
Krystal Jackson, Deepika Raman, Jakub Kryś +8
We investigate the design of robust risk models to assess societal risks posed by advanced AI systems, an emerging area in AI governance. Many regulatory proposals increasingly req…
Exploring Systems-Thinking Approaches to Loss of Control Risk
Aurelio Carlucci, Sean P. Fillingham, James Walpole +1
Internal deployment of agentic AI systems for coding and research creates a sociotechnical control problem that extends beyond model behaviour. We treat internal-deployment Loss of…
Lessons from External Review of DeepMind's Scheming Inability Safety Case
Stephen Barrett, Francisco Javier Campos Zabala, Sean P. Fillingham +4
Safety cases for frontier AI systems should provide a convincing argument, supported by evidence, that the risk of harm is within an acceptable bound. When developers author their…
STAMP/STPA Informed Characterization of Factors Leading to Loss of Control in AI Systems
Steve Barrett, Anna Bruvere, Sean P. Fillingham +2
A major concern amongst AI safety practitioners is the possibility of loss of control, whereby humans lose the ability to exert control over increasingly advanced AI systems. The r…