19 citations · 123 across the 25 of their papers we have counts for
3 papers · 2 filters
Optimal Policies Tend to Seek Power
Alexander Matt Turner, Logan Smith, Rohin Shah +2
Some researchers speculate that intelligent reinforcement learning (RL) agents would be incentivized to seek resources and power in pursuit of their objectives. Other researchers p…
The Choice Function Framework for Online Policy Improvement
Murugeswari Issakkimuthu, Alan Fern, Prasad Tadepalli
There are notable examples of online search improving over hand-coded or learned policies (e.g. AlphaZero) for sequential decision making. It is not clear, however, whether or not…
Conservative Agency via Attainable Utility Preservation
Alexander Matt Turner, Dylan Hadfield-Menell, Prasad Tadepalli
Reward functions are easy to misspecify; although designers can make corrections after observing mistakes, an agent pursuing a misspecified reward function can irreversibly change…