Generative Memory for Lifelong Reinforcement Learning
arXiv:1902.08349
Abstract
Our research is focused on understanding and applying biological memory transfers to new AI systems that can fundamentally improve their performance, throughout their fielded lifetime experience. We leverage current understanding of biological memory transfer to arrive at AI algorithms for memory consolidation and replay. In this paper, we propose the use of generative memory that can be recalled in batch samples to train a multi-task agent in a pseudo-rehearsal manner. We show results motivating the need for task-agnostic separation of latent space for the generative memory to address issues of catastrophic forgetting in lifelong learning.
Abstract NICE 2019 conference
References in corpus (6)
- Overcoming catastrophic forgetting in neural networks
- PathNet: Evolution Channels Gradient Descent in Super Neural Networks
- Variational Continual Learning
- Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization
- Generative replay with feedback connections as a general strategy for continual learning
- Online Contrastive Divergence with Generative Replay: Experience Replay without Storing Data