Efficient Reinforcement Learning by Reducing Forgetting with Elephant Activation Functions

Qingfeng Lan, Gautham Vasan, A. Rupam Mahmood

Catastrophic forgetting has remained a significant challenge for efficient reinforcement learning for decades (Ring 1994, Rivest and Precup 2003). While recent works have proposed…