Learning a Shield from Catastrophic Action Effects: Never Repeat the Same Mistake

Shahaf S. Shperberg, Bo Liu, Peter Stone

Agents that operate in an unknown environment are bound to make mistakes while learning, including, at least occasionally, some that lead to catastrophic consequences. When humans…