15 citations · 27 across the 6 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.AI2019★ 1 cited
Optimal Policies Tend to Seek Power
Alexander Matt Turner, Logan Smith, Rohin Shah +2
Some researchers speculate that intelligent reinforcement learning (RL) agents would be incentivized to seek resources and power in pursuit of their objectives. Other researchers p…
cs.AI2019★ 15 cited
Conservative Agency via Attainable Utility Preservation
Alexander Matt Turner, Dylan Hadfield-Menell, Prasad Tadepalli
Reward functions are easy to misspecify; although designers can make corrections after observing mistakes, an agent pursuing a misspecified reward function can irreversibly change…