831 citations · 3.2k across the 65 of their papers we have counts for
4 papers · 2 filters
Inverse Reward Design
Dylan Hadfield-Menell, Smitha Milli, Pieter Abbeel +2
Autonomous agents optimize the reward function we give them. What they don't know is how hard it is for us to design a reward function that actually captures what we want. When des…
Servant of Many Masters: Shifting priorities in Pareto-optimal sequential decision-making
Andrew Critch, Stuart Russell
It is often argued that an agent making decisions on behalf of two or more principals who have different utility functions should adopt a {\em Pareto-optimal} policy, i.e., a polic…
Meta-Learning MCMC Proposals
Tongzhou Wang, Yi Wu, David A. Moore +1
Effective implementations of sampling-based probabilistic inference often require manually constructed, model-specific proposals. Inspired by recent progresses in meta-learning for…
Should Robots be Obedient?
Smitha Milli, Dylan Hadfield-Menell, Anca Dragan +1
Intuitively, obedience -- following the order that a human gives -- seems like a good property for a robot to have. But, we humans are not perfect and we may give orders that are n…