387 citations · 971 across the 40 of their papers we have counts for
3 papers · 1 filter
Inverse Reward Design
Dylan Hadfield-Menell, Smitha Milli, Pieter Abbeel +2
Autonomous agents optimize the reward function we give them. What they don't know is how hard it is for us to design a reward function that actually captures what we want. When des…
Pragmatic-Pedagogic Value Alignment
Jaime F. Fisac, Monica A. Gates, Jessica B. Hamrick +7
As intelligent systems gain autonomy and capability, it becomes vital to ensure that their objectives match those of their human users; this is known as the value-alignment problem…
Should Robots be Obedient?
Smitha Milli, Dylan Hadfield-Menell, Anca Dragan +1
Intuitively, obedience -- following the order that a human gives -- seems like a good property for a robot to have. But, we humans are not perfect and we may give orders that are n…