When a Reinforcement Learning Agent Encounters Unknown Unknowns

Juntian Zhu, Miguel de Carvalho, Zhouwang Yang +1

An AI agent might surprisingly find she has reached an unknown state which she has never been aware of -- an unknown unknown. We mathematically ground this scenario in reinforcemen…