107 citations · 311 across the 8 of their papers we have counts for
3 papers · 1 filter
Power-seeking can be probable and predictive for trained agents
Victoria Krakovna, Janos Kramar
Power-seeking behavior is a key source of risk from advanced AI, but our theoretical understanding of this phenomenon is relatively limited. Building on existing theoretical result…
Guidelines for Artificial Intelligence Containment
James Babcock, Janos Kramar, Roman V. Yampolskiy
With almost daily improvements in capabilities of artificial intelligence it is more important than ever to develop safety software for use by the AI research community. Building o…
The AGI Containment Problem
James Babcock, Janos Kramar, Roman Yampolskiy
There is considerable uncertainty about what properties, capabilities and motivations future AGIs will have. In some plausible scenarios, AGIs may pose security risks arising from…