What Did You Think Would Happen? Explaining Agent Behaviour Through Intended Outcomes

Herman Yau, Chris Russell, Simon Hadfield

We present a novel form of explanation for Reinforcement Learning, based around the notion of intended outcome. These explanations describe the outcome an agent is trying to achiev…