2 papers
cs.AI2020
Avoiding Side Effects in Complex Environments
Alexander Matt Turner, Neale Ratzlaff, Prasad Tadepalli
Reward function specification can be difficult. Rewarding the agent for making a widget may be easy, but penalizing the multitude of possible negative side effects is hard. In toy…
cs.AI2019
Conservative Agency via Attainable Utility Preservation
Alexander Matt Turner, Dylan Hadfield-Menell, Prasad Tadepalli
Reward functions are easy to misspecify; although designers can make corrections after observing mistakes, an agent pursuing a misspecified reward function can irreversibly change…