Optimal Policies Tend to Seek Power

Alexander Matt Turner, Logan Smith, Rohin Shah +2

Some researchers speculate that intelligent reinforcement learning (RL) agents would be incentivized to seek resources and power in pursuit of their objectives. Other researchers p…