Example When Local Optimal Policies Contain Unstable Control

Bing Song, Jean-Jacques Slotine, Quang-Cuong Pham

We provide a new perspective to understand why reinforcement learning (RL) struggles with robustness and generalization. We show, by examples, that local optimal policies may conta…